Managing Inference Services

Once an inference service has been created, you can view its details, update its configuration, or delete it.

Common questions this page answers:

• How do I view my inference services?
• How do I update an inference service?
• Can I change the container image on an inference service?

Viewing inference services

View all active inference services for a model from the Inferencing tab:

1. Open the model page
2. Navigate to the Inferencing tab - this is where all services are managed
3. All active inference services are listed with their image, description, and status

Updating a service

Update an inference service's configuration from the service's settings panel:

1. Navigate to the Inferencing tab on the model page
2. Select the service you want to update - this opens the service detail view
3. Click View Settings to open the configuration panel
4. Modify the fields as needed:
   • Description
   • Port
   • Processor Type
   • Memory (CPU only)
5. Save your changes

Note: You cannot change the container image of an existing inference service. To use a different image, delete the current service and create a new one.

Deleting a service

Deleting an inference service can only be done via the API:

DELETE /api/v2/model/{modelId}/inference/{image}/{tag}

Deleting a service stops it and removes the deployment. This action cannot be undone.

Programmatic access

Inference services can also be managed via the API.

Related pages

• Creating an Inference Service - Setting up a new service
• OpenAPI Reference - Full API documentation