Serverless GPU-backed AI inference at the edge running a catalogue of open-source text, image, speech, and embedding models (Llama, Mistral, Stable Diffusion, Whisper, BGE) with pay-per-neurone pricing and direct binding from Workers code
Jurisdictional exposure
Attributes
- Served From
- Cloudflare GPU edge
Sub-services (5)
Text Generation
Llama, Mistral, Gemma, Phi and other open-source LLMs served from edge GPUs
Image Generation
Stable Diffusion, Flux, and partner image models for text-to-image workflows
Speech Models
Whisper speech-to-text and partner voice models for real-time audio workloads
Embeddings
BGE and partner embedding models optimised for Vectorize upserts
AI Gateway
Managed proxy with caching, rate limits, and analytics across model providers
Compliance & Certifications
This service is attested for the following frameworks. Always verify with the provider before relying on a specific compliance posture.
Where this runs
Commercial regions (29)
Europe (10)
- Paris
- Frankfurt
- Dublin
- Milan
- Amsterdam
- Warsaw
- Madrid
- Stockholm
- Zurich
- London
North America (4)
- Toronto
- Ashburn
- Chicago
- San Jose
South America (2)
- Buenos Aires
- São Paulo
Asia (6)
- Hong Kong
- Mumbai
- Tokyo
- Singapore
- Seoul
- Taipei
Oceania (2)
- Sydney
- Auckland
Middle East (2)
- Tel Aviv
- Dubai
Africa (3)
- Lagos
- Cape Town
- Johannesburg
Tags
Equivalent services on other platforms
Alibaba's flagship open-source foundation model family covering Qwen (text), Qwen-VL (vision-language), Qwen-Audio, and Qwen-Coder — accessible via the DashScope API with chat, completion, embeddings, and function-calling endpoints
Build generative AI applications with foundation models from Anthropic (Claude Opus 4.7 from April 2026), Cohere, Meta, Mistral, Stability AI, TwelveLabs (video understanding), and Amazon's own Nova family — accessed via a single API with fine-tuning, knowledge bases, agents, and a model marketplace for discovery and easy onboarding
AWS-built foundation model family covering text (Micro, Lite, Pro, Premier), image generation (Canvas), and video generation (Reel) — accessed through the Bedrock runtime with tight pricing and low-latency streaming, launched at re:Invent 2024
Enterprise access to OpenAI models including GPT-4, GPT-3.5, and DALL-E with Azure security, private networking, regional deployments, and pay-as-you-go or provisioned throughput
End-to-end AI platform (formerly MLflow + Mosaic ML) for training, fine-tuning, deploying, and monitoring foundation models and custom ML models on the Lakehouse
AI inference runtime that deploys models to Gcore's edge POPs and routes requests to the nearest GPU-backed endpoint, with support for open-source LLMs and custom model containers
Unified platform to build, deploy, and scale ML models with AutoML, custom training on TPUs and GPUs, model registry, pipelines, feature store, and generative AI studio
Direct API access to Google's most capable multimodal AI models with text, image, audio, and video understanding, long context windows, and function calling support
Enterprise AI studio for training, validating, tuning, and deploying foundation models and traditional ML models, with IBM's Granite model family, Hugging Face integration, prompt lab, synthetic data generation, and governance via watsonx.governance
Kakao's Korean-first foundation-model family (Kanana Flash / Essence / Nano) for chat, code, and embeddings — multilingual but tuned for Korean conversational performance
Naver's HyperCLOVA X foundation-model platform for Korean-language LLM workloads — chat completion, embeddings, function calling, RAG over Korean text with strong native-language performance
Fully managed service offering Cohere and Llama large language models
Managed inference for open-source LLMs (Llama, Mistral, DeepSeek) hosted in EU datacentres
Fully managed AI and ML service offering hosted LLMs, vector search, and ML functions inside Snowflake SQL
Tencent's in-house family of large language models (Hunyuan-Pro, Standard, Lite, plus multimodal Hunyuan-Vision) accessible via the Hunyuan API, with enterprise-grade context windows up to 256K, function calling, embeddings, and tuning