Infr.tools
  • Introduction
  • Getting Started
    • Prerequisites
    • Platform Overview
    • Installation and Setup
  • Marketplace Integration
    • Accessing the Marketplace
    • Deploying a Model via Marketplace
    • Monitoring the Deployment
  • Advanced Usage
    • Custom Deployment with InfrAi CLI
  • Group 1
    • Community and Documentation
    • Contact Us
Powered by GitBook
On this page
  1. Getting Started

Platform Overview

Core Features

  1. Model Serving Frameworks: Support for TensorFlow Serving, TorchServe, and custom FastAPI.

  2. API Communication: REST and gRPC for seamless interaction.

  3. Scalable Infrastructure: Auto-scaling to handle varying workloads.

  4. Edge Deployment: Reduced latency with geographically distributed nodes.

  5. Monitoring Tools: Real-time insights into model performance.

How It Works

  1. Upload Models: Use the InfrAI CLI or dashboard to upload your trained models.

  2. Select Deployment Options: Choose framework, container environment, and API protocol.

  3. Launch Deployment: Deploy on decentralized nodes via one-click options.

  4. Monitor Performance: Access dashboards for latency, throughput, and more.

PreviousPrerequisitesNextInstallation and Setup

Last updated 1 month ago