Recursively Download from a Shadow Bucket

I have a shadow bucket setup that we are using to mirror objects from S3. I need to download all objects under a specific prefix but I get a 404 unless I download a specific object. Is it possible to do this with a shadow bucket?

Dr. Judah Schuster OP•1/21/26, 3:00 PM

This is a great ask, but unfortunately, it’s not currently supported. I’ll have a feature request for this on our side. To unblock for now, one option is to perform a list on that prefix from s3 and then perform get so that automatically migrated to Tigris.

Thanks for the response. Listing does not seem to show objects other than those that have already been copied into tigris with an explicit cp. Could you show an example of this working?

Currently, it is only supported for the shadow buckets that are configured in “Write Through” mode where list results are fetched from the shadow source. Otherwise, you’re right. The results are returned from Tigris.

I was suggesting if you explicitly perform list on s3 and then, based on the results you get from s3, you perform get on Tigris. This will trigger the migration of these objects to Tigris.

Let me know if this helps; happy to help you more on the migration. If you want, you can also reach out to us directly at help@tigrisdata.com.