Generative AI System Design
As we’ve seen, generative AI is a rapidly evolving field full of opportunities for practitioners and organizations. However, due to the non-deterministic nature of LLMs and the rapid evolution of the technology, designing and building generative AI systems comes with many challenges. In this chapter, we’ll guide you through the process of building generative AI systems while steering clear of these challenges, from conceptualization to implementation.
In this chapter, we’ll cover the following topics:
- Architecting for generative AI systems
- Reference generative AI system blueprints
- Technical design approach
- Considerations for enterprise readiness and compliance
- How are generative AI systems different?
System design in software engineering is difficult as we need to achieve complex functional and non-functional requirements with limited resources. Almost every system is a tradeoff between performance,...