Câu 27: Databricks Certified Generative AI Engineer Associate

A Generative AI Engineer developed an LLM application using the provisioned throughput Foundation Model API. Now that the application is ready to be deployed, they realize their volume of requests are not sufficiently high enough to create their own provisioned throughput endpoint. They want to choose a strategy that ensures the best cost-effectiveness for their application. What strategy should the Generative AI Engineer use?

1. A. Switch to using External Models instead
2. B. Deploy the model using pay-per-token throughput as it comes with cost guarantees — đáp án hiện tại
3. C. Change to a model with a fewer number of parameters in order to reduce hardware constraint issues
4. D. Throttle the incoming batch of requests manually to avoid rate limiting issues