SkyPilot Quickstart | Tigris Object Storage Documentation

On this page

SkyPilot is an open-source framework for running AI and batch workloads on any infrastructure provider, anywhere. Flexibly provision compute in any cloud with the same common configuration-- no switch statements or analyzing instance types.

Tigris enables this extreme portability by globally distributing your data so it's always close to the compute SkyPilot dynamically provisions. Since Tigris is a no egress fee storage provider, you don't have to worry about additional costs by going multi-cloud.

How to install SkyPilot

There's a few ways to set up SkyPilot, here's the easiest methods:

Conda

If you already use conda, follow the upstream guide on how to install SkyPilot. Make sure to install the adaptor for your infrastructure:

pip install "skypilot[aws]"

pip install "skypilot[kubernetes]"

# ...

Or mix and match:

pip install -U "skypilot[kubernetes,aws,gcp]"

How to use Docker to run SkyPilot

If you want to skip the grind and just get started, run this docker command to set up SkyPilot in a container:

# NOTE: '--platform linux/amd64' is needed for Apple silicon Macs

docker run --platform linux/amd64 \

-td --rm --name sky \

-v "$HOME/.sky:/root/.sky:rw" \

-v "$HOME/.aws:/root/.aws:rw" \

-v "$HOME/.config/gcloud:/root/.config/gcloud:rw" \

berkeleyskypilot/skypilot

Then open a shell with docker exec:

docker exec -it sky /bin/bash

How to use Tigris with SkyPilot

If you're running a training job or storing model weights, reference these guides:

• Using model weights in Tigris anywhere with SkyPilot
• Training with Big Data on SkyPilot

Otherwise, use boto3 to interact with Tigris:

# Create S3 service client

svc = boto3.client(

's3',

endpoint_url='https://t3.storage.dev',

config=Config(s3={'addressing_style': 'virtual'}),

)

# List buckets

response = svc.list_buckets()

for bucket in response['Buckets']:

print(f'  {bucket["Name"]}')

# List objects

response = svc.list_objects_v2(Bucket='tigris-example')

for obj in response['Contents']:

print(f'  {obj["Key"]}')

# Upload file

response = svc.upload_file('getting-started.py', 'tigris-example', 'getting-started.py')

# Download file

response = svc.download_file('tigris-example', 'getting-started.py', 'getting-started-2.py')

Now you have SkyPilot installed with Tigris. Enjoy building!