Câu 26: NCP-AAI: Agentic AI
When evaluating optimization opportunities between NeMo Guardrails, NIM microservices, and TensorRT-LLM in a production healthcare agent, which analysis approach best identifies optimization opportunities across the NVIDIA stack?
Nội dung câu hỏi
When evaluating optimization opportunities between NeMo Guardrails, NIM microservices, and TensorRT-LLM in a production healthcare agent, which analysis approach best identifies optimization opportunities across the NVIDIA stack?
Các lựa chọn
Đáp án được giữ gọn theo nhãn A, B, C, D trong phần bình chọn tương tác.
- A. Conduct stress testing of individual microservices and guardrails to measure peak throughput and determine theoretical performance limits of each module.
- B. Use default configurations to establish a deployment baseline, focusing on stability before conducting deeper performance profiling.
- C. Create end-to-end latency waterfalls that capture guardrail overhead, NIM queuing delays, and TensorRT optimization benefits while assessing overall pipeline efficiency. — đáp án hiện tại
- D. Tune each component individually, focusing primarily on local performance metrics with secondary attention to integration patterns.
Cộng đồng
0 bình luận công khai. Tên thành viên được ẩn một phần.
Chưa có bình luận. Mở giao diện tương tác để bắt đầu thảo luận.