Function createAwsBedrockModelProvider

Creates an AWS Bedrock ModelProvider with the provided ModelApi.

import {
  AmazonTitanTextApi,
  createAwsBedrockModelProvider
} from "generative-ts";

// Bedrock supports many different APIs and models. See below for full list.
const titanText = createAwsBedrockModelProvider({
  api: AmazonTitanTextApi,
  modelId: "amazon.titan-text-express-v1",
  // If your code is running in an AWS Environment (eg, Lambda) authorization will happen automatically. Otherwise, explicitly pass in `auth`
});

const response = await titanText.sendRequest({
  $prompt: "Brief history of NY Mets:"
  // all other options for the specified `api` available here
});

console.log(response.results[0]?.outputText);
Copy

Compatible APIs

• AmazonTitanTextApi
• CohereGenerateApi
• Llama2ChatApi
• Llama3ChatApi
• MistralBedrockApi
• Ai21Jurassic2Api

Provider Setup and Notes

In the Bedrock service in the AWS Console, use "Request Model Access" to enable access to Bedrock models.

Authorization

If your code is running in an AWS Environment (eg, Lambda) authorization should happen automatically. Otherwise, explicitly pass in AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY to auth.

Region is also specified in auth as AWS_REGION. If not passed, it will be read from process.env.

Model Parameters

• AWS Bedrock Model Parameters

Model IDs

• AWS Bedrock Models

See

• AWS Bedrock Model Parameters
• AWS Bedrock Models

Example: Multiple APIs

import {
  Ai21Jurassic2Api,
  AmazonTitanTextApi,
  CohereGenerateApi,
  createAwsBedrockModelProvider,
  Llama3ChatApi,
  MistralBedrockApi,
} from "generative-ts";

const titanText = createAwsBedrockModelProvider({
  api: AmazonTitanTextApi,
  modelId: "amazon.titan-text-express-v1",
});

const cohereCommand = createAwsBedrockModelProvider({
  api: CohereGenerateApi,
  modelId: "cohere.command-text-v14",
});

const llama3 = createAwsBedrockModelProvider({
  api: Llama3ChatApi,
  modelId: "meta.llama3-8b-instruct-v1:0",
});

const mistral = createAwsBedrockModelProvider({
  api: MistralBedrockApi,
  modelId: "mistral.mistral-7b-instruct-v0:2",
});

const jurassic = createAwsBedrockModelProvider({
  api: Ai21Jurassic2Api,
  modelId: "ai21.j2-mid-v1",
});

const params = { $prompt: "Brief history of NY Mets:" };

const responses = await Promise.all([
  titanText.sendRequest(params),
  cohereCommand.sendRequest(params),
  llama3.sendRequest(params),
  mistral.sendRequest(params),
  jurassic.sendRequest(params),
]);
Copy