tpl/pytorch-http
Template
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

docs: readme

Browse Source
This commit is contained in:
orion 2023-09-18 13:02:36 -05:00
parent 48bded9bf1
commit 0f291c762e
Signed by: orion
GPG Key ID: 6D4165AE4C928719
1 changed files with 1 additions and 11 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
README.md
View File

@ -1,11 +1 @@
# Open LLaMA # Flan-T5 HTTP API
Run [OpenLLaMA](https://github.com/openlm-research/open_llama) in a GPU environment with a single command. 📡
## Speed Run
1. Signup for [Beam](http://beam.cloud)
2. Download the CLI and Python SDK
3. Clone this template locally: `beam create-app openllama`
4. Spin up a GPU environment to run inference: `beam start app.py`
5. Deploy the app as a web API: `beam deploy app.py`