Install

.package(url: "https://github.com/ShenghaiWang/SwiftLlama.git", from: "0.4.0")

Usage

1 Initialise swiftLlama using model path.

let swiftLlama = try SwiftLlama(modelPath: path))

2 Call it

Call without streaming

let response: String = try await swiftLlama.start(for: prompt)

Using AsyncStream for streaming

for try await value in await swiftLlama.start(for: prompt) {    result += value}

Using Combine publisher for streaming

await swiftLlama.start(for: prompt)    .sink { _ in    } receiveValue: {[weak self] value in        self?.result += value    }.store(in: &cancallable)

Test projects

Supported Models

Welcome to contribute!!!