Question 29: AI-500: Designing and Implementing Multi-Agent AI Solutions
You have a multi-agent solution in Microsoft Foundry. Every request begins with the same 1,800-token instruction block and Model Context Protocol (MCP) tool definitions, and then appends a unique user message.Input-token costs and Time to First Token (TTFT) increase during peak hours. You need to reduce the input-toke…
Nội dung câu hỏi
You have a multi-agent solution in Microsoft Foundry. Every request begins with the same 1,800-token instruction block and Model Context Protocol (MCP) tool definitions, and then appends a unique user message.Input-token costs and Time to First Token (TTFT) increase during peak hours. You need to reduce the input-token costs and TTFT for requests that share common instructions and tool definitions. The solution must meet the following requirements:Reuse cached work only when the common prefix matches exactly. Generate a new completion for each user request. Minimize application changes. Which type of caching should you use?
Các lựa chọn
Đáp án được giữ gọn theo nhãn A, B, C, D trong phần bình chọn tương tác.
- A. retrieval caching
- B. semantic caching
- C. response caching
- D. prompt caching — đáp án hiện tại
Answer researched independently against supporting documentation; not a published source answer key. The repeated exact prefix can reuse prompt computation while each request still generates a fresh completion. References: https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/prompt-caching
Cộng đồng
0 bình luận công khai. Tên thành viên được ẩn một phần.