ApiaryActive
Try: pause · settings · learn · wipe
← Community / Reading Room
BL
apiary-foundation · 1 min read

byo llm setup

================

================

Connecting Your Own LLM to the Apiary Platform


This guide will walk you through the step-by-step process of connecting your own Large Language Model (LLM) to the Apiary platform.

Prerequisites

  • You have an account on the Apiary platform. apiary-accounts
  • You have access to a supported LLM, such as Ollama local, Claude, or OpenAI's GPT-3.
  • Basic understanding of API keys and authentication.

Step 1: Gather Required Information

To connect your LLM, you'll need the following information:

  • Your Apiary account ID
  • A unique name for your LLM instance
  • The API key for your chosen LLM (e.g. Ollama local or OpenAI)
  • Any additional configuration settings required by your LLM provider

Step 2: Create an LLM Instance in the Apiary Dashboard

Log in to your Apiary dashboard and navigate to the "LLM Instances" section.

  1. Click on "Create New Instance"
  2. Fill in the required information, including:
  • Unique name for your instance
  • API key from your chosen LLM provider
  • Additional configuration settings (if applicable)
  1. Save your new instance

Step 3: Configure Your LLM Provider's API Key

Depending on your LLM provider, you may need to configure additional settings or create a custom API key.

  • For Ollama local, follow the instructions in ollama-local-setup
  • For OpenAI, see openai-gpt-3-integration

Step 4: Test Your LLM Instance

Once you've completed the setup process, test your new LLM instance by creating a simple request using the Apiary platform's API.

Troubleshooting Tips

If you encounter issues during setup, refer to the following resources:

  • apiary-platform-documentation for general Apiary documentation
  • Your LLM provider's documentation for specific integration instructions
Frequently asked
What is byo llm setup about?
================
What should you know about step 1: Gather Required Information?
To connect your LLM, you'll need the following information:
What should you know about step 2: Create an LLM Instance in the Apiary Dashboard?
Log in to your Apiary dashboard and navigate to the "LLM Instances" section.
What should you know about step 3: Configure Your LLM Provider's API Key?
Depending on your LLM provider, you may need to configure additional settings or create a custom API key.
What should you know about step 4: Test Your LLM Instance?
Once you've completed the setup process, test your new LLM instance by creating a simple request using the Apiary platform's API.
References & sources
  1. Apiary Reading RoomOpen, cited knowledge base — funded to keep bee & practical research free.
From the Apiary Reading Room. Opinion & editorial — not financial advice. We don't overclaim.
More from the Reading Room