Continue with 6bee.ai
Continue reads its models from a config file. Add one block with the 6bee.ai base URL, your key and a model ID.
Before you start
- The Continue extension installed in VS Code or a JetBrains IDE.
- Create an account with a verified email address, add prepaid balance, then create a key on the console's API keys page. Keep the key secret.
- Model IDs are listed in the console and returned by
GET https://api.6bee.ai/v1/models. Replace<model id>with one of them.
Add the model
Open ~/.continue/config.yaml (in Continue: the model menu, then the gear next to Local Config) and add a model:
name: 6bee
version: 1.0.0
schema: v1
models:
- name: 6bee
provider: openai
model: <model id>
apiBase: https://api.6bee.ai/v1
apiKey: <your key>
roles:
- chat
- edit
- apply provideropenai. Continue then speaks the OpenAI Chat Completions format.apiBasehttps://api.6bee.ai/v1, with/v1.roles- What Continue may use the model for. Leave out
autocomplete: it fires on every keystroke and quickly reaches the request limit.
This file holds your key in plain text. Do not commit it to a repository.
Check that it works
- Save the file. Continue reloads it.
- Pick 6bee in the model menu and send a short message.
- The request shows up in the console’s usage log.
Limits
- Context
- Input plus output up to the model’s window: 128K to 1M tokens, depending on the model.
- Output
- max_tokens up to the model’s output cap: 16,384 to 131,072, depending on the model. Larger values are lowered to the cap, not rejected. If omitted: 8,192 to 32,768.
- Input tokens
- 1,000,000 uncached tokens per rolling minute. Cache hits don’t count.
- Requests
- 60 per minute.
- Concurrency
- 2 requests at a time.
- Request body
- Up to 8 MiB. n must be 1.
Troubleshooting
- HTTP 401
- The key is missing or wrong. Copy it again from the console, without spaces or quotes.
- Model not found
- The model ID does not match. List the valid IDs with
GET /v1/modelsor check the console. - HTTP 429
- You are over a per-account limit (requests, input tokens or concurrency). The
Retry-Afterheader says how long to wait. - HTTP 400 on long sessions
- The request no longer fits the model’s context window. Compact or clear the conversation, or switch to a model with a larger window.
- Request rejected for balance
- Each request first reserves its input plus
max_tokensof output. Top up, or lowermax_tokens.