gintonic modular blockchain for AI
  • Gintonic Hub
  • Live Subchains
    • Distillery Intro
    • Inference Intro
    • PrivateAI Intro
  • Planned Subchains
    • Service Discovery Intro
    • language Processing Intro
    • Forecasting Intro
    • Model Monitoring Intro
    • Deployment Intro
    • Pipeline Intro
    • AI Governance Intro
    • Training Intro
    • Fine-tuning Intro
    • Storage Intro
    • Data Transfer Intro
    • Data Lake Intro
  • Inference Subchain Guide
    • Getting Started
    • Core Concepts
    • API Reference
    • Best Practices
    • Billing and Usage
    • Troubleshooting
    • FAQs
  • Distillery Subchain Guide
    • Getting Started
    • Joining the Network
    • Earning Rewards
    • Managing Your Node
    • Troubleshooting
    • Glossary of Terms
    • FAQ
  • Private AI Subchain Guide
Powered by GitBook
On this page
  • Overview
  • How It Works
  • Benefits for Developers
  • Synergy with the distillery Subnet
  • Empowering AI-Driven Innovation
  1. Live Subchains

Inference Intro

Discover the Gintonic inference subchain, bridging developers with distributed AI capabilities. Learn about its cost-efficient, scalable solution for running AI models.

PreviousDistillery IntroNextPrivateAI Intro

Last updated 8 months ago


Overview

The Gintonic inference subchain serves as a crucial interface between developers and the powerful distributed AI infrastructure of the Gintonic ecosystem. This subchain provides a seamless API layer that allows developers to harness the capabilities of large language models, beginning with the Mistral LLM, in a cost-effective and scalable manner.

Visit the the to get started!

How It Works

At its core, the inference subchain acts as an intelligent intermediary:

  1. It receives inference requests from developers through a standardized API.

  2. These requests are then efficiently routed to the distillery subchain.

  3. The distillery subchain distributes the computational tasks across its network of GPU-powered nodes.

  4. Once processed, the results are returned to the inference subchain, which then delivers them back to the developer.

This process leverages the distributed nature of the Gintonic ecosystem to offer high-performance AI inference without the need for developers to manage complex infrastructure.

Benefits for Developers

The inference subchain offers several key advantages for developers:

  • Cost Efficiency: Provides a more affordable alternative to traditional centralized cloud LLM services.

  • Familiar Integration: Offers an API similar to well-known services like AWS Bedrock or Google Vertex AI, ensuring a smooth transition for developers.

  • Scalability: Leverages the distributed nature of the Gintonic ecosystem to handle varying loads efficiently.

  • Access to Advanced Models: Starting with the Mistral LLM, with plans to expand to other cutting-edge models in the future.

Synergy with the distillery Subnet

The inference subchain works in close harmony with the distillery subchain:

  • While the distillery subchain manages the distributed processing of AI tasks, the inference subchain handles the developer-facing interactions.

  • This separation of concerns allows each subchain to optimize for its specific role, resulting in a more efficient and robust overall system.

Empowering AI-Driven Innovation

By providing easy access to powerful AI capabilities, the inference subchain empowers developers to:

  1. Build more intelligent and responsive applications.

  2. Experiment with advanced AI models without significant upfront investment.

  3. Scale their AI-driven features alongside their application's growth.

Join us in revolutionizing AI accessibility and unleashing the power of distributed inference in your applications!

Visit the the to get started!

inference subchain guide
inference subchain guide