OpenAI-compatible API server powered by Apple’s on-device Foundation Models

Features •Requirements •Build & Install •Usage •License •References

🌟 Overview

📸 App Screenshots

Main Dashboard - Light Theme

Main Dashboard - Dark Theme

Chat Interface

🚀 Features

🛠️ Requirements

📦 Building and Installation

Prerequisites

Build Steps

❓ Why a GUI App Instead of CLI?

📖 Usage

Starting the Server

📡 Available Endpoints

💡 Example Usage

Usingcurl

# Englishcurl -X POST http://127.0.0.1:11435/v1/chat/completions   -H"Content-Type: application/json"   -d'{    "model": "apple-fm-base",    "messages": [{"role": "user", "content": "Hello, how are you?"}],    "temperature": 0.7,    "stream": false  }'# Frenchcurl -X POST http://127.0.0.1:11435/v1/chat/completions   -H"Content-Type: application/json"   -d'{    "model": "apple-fm-base",    "messages": [{"role": "user", "content": "Bonjour, comment allez-vous?"}],    "stream": false  }'# Italiancurl -X POST http://127.0.0.1:11435/v1/chat/completions   -H"Content-Type: application/json"   -d'{    "model": "apple-fm-base",    "messages": [{"role": "user", "content": "Ciao, come stai?"}],    "stream": false  }'

Using OpenAI Python Client

fromopenaiimportOpenAIclient=OpenAI(base_url="http://127.0.0.1:11435/v1",api_key="not-needed")# --- English (streaming example) ---print("🔹 English:")stream=client.chat.completions.create(model="apple-fm-base",messages=[{"role":"user","content":"Hello, how are you?"}],temperature=0.7,stream=True,)forchunkinstream:ifchunk.choices[0].delta.content:print(chunk.choices[0].delta.content,end="")print("\n")# --- French (non-streaming example) ---print("🔹 French:")resp_fr=client.chat.completions.create(model="apple-fm-base",messages=[{"role":"user","content":"Bonjour, comment allez-vous?"}],stream=False,)print(resp_fr.choices[0].message.content)print()# --- Italian (non-streaming example) ---print("🔹 Italian:")resp_it=client.chat.completions.create(model="apple-fm-base",messages=[{"role":"user","content":"Ciao, come stai?"}],stream=False,)print(resp_it.choices[0].message.content)

📜 License

📚 References

🙏 Credits

_{Built with 🍎 + ❤️ by the open-source community}