Integrate with external tools through tool support in OCI Generative AI

OCI Generative AI has added tool support to Llama models, enabling them to integrate with external tools and APIs to enhance the models' responses.

A tool call can help a model produce contextually relevant responses and also broadens its utility, enabling the model to handle complex queries and perform tasks that require external data and processing. For example, with tool calls, you can have a model fetch real-time data, run code, and interact with databases. Tool support is available only through the API.

  • For Meta Llama models, see the new tools attribute in the GenericChatRequest API reference.

  • For Cohere models, see the tools attribute in the CohereChatRequest API reference.

For information about the service, see the Generative AI documentation.