Instructions to use LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- MLX LM
How to use LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4", "messages": [ {"role": "user", "content": "Hello"} ] }'
Bielik-11B-v3.0-mlx-mxfp4
Bielik-11B-v3.0-mlx-mxfp4 is an MLX MXFP4 packaging of speakleash/Bielik-11B-v3.0-Instruct for Polish and multilingual instruction-style generation on Apple Silicon.
Intended use
- Local text generation and chat-style prompting on Apple Silicon
- MLX-LM experimentation with the declared upstream model family
- Offline or operator-controlled inference workflows
Out of scope
- Safety-critical decisions without domain expert review
- Claims of benchmark superiority not backed by published evaluation data
- Non-MLX runtime guarantees; this card documents the shipped HF checkpoint, not every possible serving stack
Training and conversion metadata
| Parameter | Value |
|---|---|
| Repository | LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4 |
| Base model | speakleash/Bielik-11B-v3.0-Instruct |
| Task | text-generation |
| Library | mlx |
| Format | MLX / Apple Silicon checkpoint |
| Quantization | MXFP4 |
| Architecture | LlamaForCausalLM |
| Model files | 2 |
| Config model_type | llama |
This card only reports metadata present in the Hugging Face repository, existing card frontmatter, or public config files. Missing benchmark, dataset, or training-run details are left explicit rather than reconstructed.
Tested inference path
**Inference for this checkpoint has been tested with
LibraxisAI/mlx-batch-server.**
This is the recommended tested path for operator-controlled local inference on Apple Silicon.
| Aspect | Status |
|---|---|
| Tested runtime | LibraxisAI/mlx-batch-server |
| Target hardware | Apple Silicon |
| Inference mode | Local / self-hosted |
| Hugging Face Hosted Inference | Disabled for this repository (inference: false) |
This does not claim compatibility with every possible serving stack. It documents the path that has been exercised for this published checkpoint.
Usage
CLI
pip install mlx-lm
mlx_lm.generate \
--model LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4 \
--prompt "Opisz krótko objawy odwodnienia u psa i kiedy pilnie skontaktować się z lekarzem weterynarii." \
--max-tokens 400
Python
from mlx_lm import load, generate
model, tokenizer = load("LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4")
prompt = "Opisz krótko objawy odwodnienia u psa i kiedy pilnie skontaktować się z lekarzem weterynarii."
response = generate(model, tokenizer, prompt=prompt, max_tokens=400)
print(response)
Multi-turn with the chat template
This checkpoint follows the tokenizer/chat-template contract inherited from speakleash/Bielik-11B-v3.0-Instruct when the
template is present in the repository:
from mlx_lm import load, generate
model, tokenizer = load("LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4")
messages = [
{"role": "user", "content": "Opisz krótko objawy odwodnienia u psa i kiedy pilnie skontaktować się z lekarzem weterynarii."},
]
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
response = generate(model, tokenizer, prompt=prompt, max_tokens=400)
print(response)
Example output
No public sample output is currently declared for this checkpoint.
Quantization notes
| Aspect | Original/base checkpoint | This checkpoint |
|---|---|---|
| Lineage | speakleash/Bielik-11B-v3.0-Instruct |
LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4 |
| Runtime target | Upstream runtime format | MLX on Apple Silicon |
| Quantization | Base precision or upstream-declared format | MXFP4 |
| Published quality delta | Not declared in public metadata | Not declared in public metadata |
Limitations
- No public benchmarks for this checkpoint are declared in the model metadata.
- No public benchmark claims are made by this card unless listed in the frontmatter.
- Validate outputs on your own domain data before relying on this checkpoint.
- Memory use and speed depend heavily on the exact Apple Silicon generation, unified-memory size, and prompt length.
License
apache-2.0. Check the upstream/base model license as well when a base model is declared.
Citation
@misc{libraxisai-bielik-11b-v3-0-mlx-mxfp4,
title = {Bielik-11B-v3.0-mlx-mxfp4},
author = {LibraxisAI},
year = {2026},
howpublished = {\url{https://huggingface.co/LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4}},
note = {MLX checkpoint published by LibraxisAI}
}
𝚅𝚒𝚋𝚎𝚌𝚛𝚊𝚏𝚝𝚎𝚍. with AI Agents by VetCoders (c)2024-2026 LibraxisAI
- Downloads last month
- 391
4-bit
Model tree for LibraxisAI/Bielik-11B-v3.0-mlx-mxfp4
Base model
speakleash/Bielik-11B-v3-Base-20250730