Skip to main content

Step 2: Deploy the enclave image on Oyster

Step 2.1: Set up a wallet​

Set up a wallet where you can export the private key. Deposit 0.001 ETH and 1 USDC to the wallet on the Arbitrum One network.

Step 2.2: Deploy the enlave​

info

Ensure to chose an instance type that fits your ollama model choice from step 1.2.

Deploy the enclave image using:

  • For amd64 systems:
# replace <key> with private key of the wallet
oyster-cvm deploy --wallet-private-key <key> --duration-in-minutes 20 --docker-compose docker-compose.yml --instance-type c6a.2xlarge --arch amd64
  • For arm64 systems:
# replace <key> with private key of the wallet
oyster-cvm deploy --wallet-private-key <key> --duration-in-minutes 20 --docker-compose docker-compose.yml --instance-type c6g.2xlarge

After deployment, capture the instance IP.

info

The llama3.2 (2GB) model takes around 4 minutes to fully initialize inside the enclave. Please allow some extra time for the setup to complete before interacting with it. The setup duration may vary depending on the model size.

Step 2.4: Deploy the enclave in debug mode​

Deploying in debug mode gives you access to the logs of the enclave. To enable debug mode, just modify the deploy command like below:

  • For amd64 systems:
# replace <key> with private key of the wallet
oyster-cvm deploy --wallet-private-key <key> --duration-in-minutes 20 --docker-compose docker-compose.yml --instance-type c6a.2xlarge --arch amd64 --debug
  • For arm64 systems:
# replace <key> with private key of the wallet
oyster-cvm deploy --wallet-private-key <key> --duration-in-minutes 20 --docker-compose docker-compose.yml --instance-type c6g.2xlarge --debug