| ... | ... | @@ -9,6 +9,8 @@ To facilitate the use of Large Language Models we now have an API service which |
|
|
|
* Using the request function of the idaLLM package you can easily send single or batched prompts
|
|
|
|
* The package [LightChain](https://github.com/Parry-Parry/LightChain/tree/main) adds further functionality for prompt chaining and easy objects for dialogue memory and complex prompts
|
|
|
|
|
|
|
|
An example of usage can be seen in [this notebook](https://drive.google.com/file/d/1b8al6N9zsdQyc7-EfXE9URSUBDfQneW3/view?usp=drive_link). NOTE: you can only access the API through the school VPN so Colab will not work
|
|
|
|
|
|
|
|
**Current Models**
|
|
|
|
|
|
|
|
Any models currently being served will be noted here, along with their corresponding URLs, notably all models should be queried at the end point /generate, documentation for the API can be found at /docs for any model
|
| ... | ... | |
