LlmTornado 3.0.0

.NET SDK for accessing the OpenAI Compatible APIs such as GPT-4 Turbo, Assistants, and DALL-E 3

OpenAiNextGeneration is a simple .NET library to use with various OpenAI compatible providers, such as OpenAI, Azure OpenAI, and KoboldCpp ( v1.45.2+). Supports features such as function calling in conjunction with streaming, caches its own HttpClients.

Supported features compared to OpenAI-API-dotnet:

• Assistants, threads, and messages support.
• Includes new models.
• Parallel function calling.
• Improved memory usage, and function calling in conjunction with streaming.
• Manages its pool of HttpClients.
• Improved credentials passing.
• Supports OpenAI-compatible API providers, such as KoboldCpp.
• Improved Azure OpenAI integration.
• Nullability annotations.
• Calls are guaranteed not to throw, full response is included in the call result. (Fully supported in 3.0+)
• Actively maintained, backed by a company I work for.

Features scheduled for open-sourcing:

• High-level plugin API.
• Approximate token counting for streaming & function calling.

⚡Getting Started

Install the library via NuGet:

Install-Package LlmTornado

🔮 Quick Inference

var api = new LlmTornado.OpenAiApi("YOUR_API_KEY");
var result = await api.Completions.GetCompletion("One Two Three One Two");
Console.WriteLine(result);
// should print something starting with "Three"

📖 Readme

• Requirements
• Installation
• Authentication
• Additonal Documentation
• License

Requirements

Unlike the original library, LlmTornado supports only .NET Core >= 6.0, if you need .NET Standard 2.0 /.NET Framework support, please use OpenAI-API-DotNet.

Getting started

Install from NuGet

Install package LlmTornado from Nuget. Here's how via the command line:

Install-Package LlmTornado

Authentication

Pass keys directly to ApiAuthentication(string key) constructor.

You use the APIAuthentication when you initialize the API as shown:

// for example
var api = new OpenAiApi("YOUR_API_KEY"); // shorthand
// or
var api = new OpenAiApi(new APIAuthentication("YOUR_API_KEY")); // create object manually

You may optionally include an OpenAi Organization if multiple Organizations are under one account.

// for example
var api = new OpenAiApi(new ApiAuthentication("YOUR_API_KEY", "org-yourOrgHere"));

Documentation

Every single class, method, and property has extensive XML documentation, so it should show up automatically in IntelliSense. That combined with the official OpenAI documentation should be enough to get started. Feel free to open an issue here if you have any questions.

License

This library is licensed under MIT license.