Deploying
In this page, we'll ship to Prod
From your Potassium App directory:
# Add recent changes
git add .
git commit -m "first changes"
# Set upstream to the Github Repo you created
git remote add origin https://github.com/USER_NAME/REPO_NAME.git
git branch -M main
# Push
git push -u origin main
When adding the Github Integration, if you choose to install "Only select repositories", be sure to select the repo you just created. You can adjust your Github Integration in the future from the Team page.
Select "Deploy from Github Repository" and select your Potassium App repo. This will build and deploy your model!
To see build progress, you can click into the model, and view the Build Logs tab.
Once built, the model will have "Deployed" status
We'll slightly modify our
client.py file from before to call our deployed model.- 1.
- 2.Find your
model_keyby clicking into the model, and add it toclient.py
Unset the
BANANA_SERVER environment variable to point the SDK at produnset BANANA_SERVER
And fire off your first call!
python3 client.py
You can track the call's progress through the queue, and view the replica spin-up to handle the call.
Once the call returns, the replica will remain warm for 10s of inactivity before shutting down.
You've made a production call to a custom BERT model on Banana!
Now you're free to go bananas, and add anything your heart tells you to.
Thank you for hosting with us.
Last modified 1mo ago