Câu 15: NCP-AAI: Agentic AI

Integrate NeMo Guardrails, configure NIM microservices for optimized inference, use TensorRT-LLM for deployment, and profile the system using Triton Inference Server with multi-modal support. Which of the following strategies aligns with best practices for operationalizing and scaling such Agentic systems?

1. A. Use Docker containers orchestrated by Kubernetes, implement MLOps pipelines for CI/CD, monitor agent health with Prometheus/Grafana. — đáp án hiện tại
2. B. Deploy agents on bare-metal servers to maximize performance and avoid container overhead, using manual scripts for orchestration and monitoring.
3. C. Deploy all agents on a single high-performance GPU node to reduce latency, and use cron jobs for periodic health checks and updates.
4. D. Run agents as independent serverless functions to minimize infrastructure management, relying primarily on cloud provider auto-scaling and logging tools.