AI infrastructure | Elyne Corp

EIE · Elyne Inference EngineOpen Source · Apache 2.0

A local GGUF inference engine, from desktop to mobile.

EIE serves chat and embeddings over HTTP. One model is enough; multiple models can be configured for parallel, sequential or fan-out execution. Application memory, documents and tools remain the responsibility of clients.

Partial OpenAI-format API compatibility, with SSE streaming.
Windows x64 CPU, macOS and Android arm64 bundles available.
Local Windows/CUDA, Windows CPU, Intel macOS and Android CPU tests; Metal use reported by the maintainer.
EWS: experimental expert-weight streaming for selected MoE models.

› Technical details

C++17 server using identified llama.cpp runtimes. Groups are implemented without full load qualification; automatic KV-cache adaptation is not operational. A Gemma 26B EWS pilot measured CUDA weight buffers of 14.424 → 4.789 decimal GB at 32 slots per layer: this is not total VRAM. A separate GLM-5.3-Flash 320B runtime completed a Next roundtrip on an RTX 4090 Laptop with 16 GiB-class VRAM and 32 GiB-class RAM: 148 tokens in 278.515 s, with CPU/GPU expert computation. These results establish feasibility in their profiles, not a general speed advantage. Android CPU text bundles were tested on a Z Flip6 / Android 16, with no APK or EWS, vision or NPU qualification. Model weights retain their own licences.

Code & documentation ↗ Evidence and limits ↗ Downloads ↗

Elyne BenchmarkPublic protocol · Apache 2.0 / CC-BY-4.0

Measuring what a persistent local-AI substrate adds to the same model.

A public three-arm benchmark: the full system, the surfaced information alone and the bare model, with the same model binding, sampling parameters and seed. The repository publishes the instrument, frozen scoring, selected evidence and an adapter protocol; it does not publish Next’s private runtime.

Three frozen batteries: accuracy (17 cases), orchestration (14) and tool chain (15).
Reference results, system / information / bare model: 15/15 · 14/15 · 6/15, 14/14 · 12/14 · 0/14 and 15/15 · 0/15 · 0/15.
Published report verifiable by script and unit tests, with SHA-256 anchors.

› Technical details

Reference observations from a single deterministic campaign, not general performance estimates; two judge-scored accuracy items remain pending. The adapter must attest identical model and sampling identities for every arm, otherwise the harness fails closed. The mock adapter only exercises the protocol and its scores are not results. Software under Apache 2.0; batteries, reports and documentation under CC-BY-4.0.

Protocol and results ↗ Methodology ↗ Limits ↗

Website publisher

Elyne Corp, a French simplified joint-stock company (SAS) with share capital of €3,000.
Registered office: 165 chemin du Ravin de Ganay, 13540 Aix-en-Provence, France.
Registered with the Aix-en-Provence Trade and Companies Register under number 995 093 879.
Contact : admin@elynecorp.com

Publication director

Alexandre De Haro.

Hosting provider

OVHcloud (OVH SAS), 2 rue Kellermann, 59100 Roubaix, France. Lille Métropole Trade and Companies Register 424 761 419. ovhcloud.com

Intellectual property

All content on this website—including text, visuals, the logo, the Elyne and TrustID trademarks, and product descriptions—is the exclusive property of Elyne Corp unless otherwise stated. The EIE engine (Elyne Inference Engine) is released separately under the Apache 2.0 license. Any reproduction, representation, or distribution, in whole or in part, without prior written authorization is prohibited.

No data collection

This website is entirely static. It uses no cookies, no trackers, no audience measurement tools, and contains no forms. It therefore collects no personal data during your visit.

Contact

If you email us at admin@elynecorp.com, your address and message are used solely to reply to you and are never shared with third parties.

Hosting

This website is hosted by OVHcloud in France, within the European Union. The hosting provider may retain technical logs, including IP addresses and requests, under its own policy for security and proper server operation.

Your rights under the GDPR

Under the General Data Protection Regulation, you have the right to access, rectify, and erase your personal data. Data controller: Elyne Corp, 165 chemin du Ravin de Ganay, 13540 Aix-en-Provence. For any request: admin@elynecorp.com.

Let’s discuss your project.