Creating an LLM Connection for Copilot

An LLM connection for Copilot can be created in one of two ways:

• via the Administration application and
• via the Create Prompt dialog.

As the steps to create an LLM connection through the Administration application have been discussed here, the following steps describe how to create an LLM connection via the Create Prompt dialog:

1. In the Graphmarts page, select a Graphmart to create a Copilot prompt.
2. In the explorer pane, select Copilot and then click Create Prompt Configuration. The Create Prompt dialog displays.

4. In the dialog, locate the LLM Connection setting and select the Add button 6. Provide the following details:

Setting	Description
Title	Required field that specifies the unique name for the annotator.
LLM Endpoint	Required field that specifies the URL of the LLM service.
LLM Provider Name
Required field that specifies the name of the LLM provider.

Some examples of LLM providers compatible with Graph Studio include:

• OpenAI
• Azure OpenAI
• Gemini
• Anthropic

| | LLM Model Name | The name of the model to use for LLM operations. | | LLM API Key | The authentication token granting access to the LLM service. This same key should be provided in the Confirm LLM API Key field. | | Can Use LLM Connection | Specifies the roles granted permission to use the LLM connection. |

8. Click Confirm to save your connection.