Other remedies

Some other technical remedies can be employed even more easily than the ones detailed in this chapter. Some of these may improve the accuracy and performance of your GenAI application, though the level of effort involved varies. As an example, during MongoDB’s testing of GPT, it was discovered that the accuracy rate for the same set of questions was improved by 7% between GPT-3.5 and GPT-4. Getting such a level of improvement in accuracy via prompting, retrieval augmentation, or late interaction strategies is certainly possible but would have been difficult.

So, it is worth investigating every avenue of potential improvement, including areas such as hardware upgrades, code optimization, concurrency management, database query optimization, and even just upgrading your software. All of these can improve the results of your GenAI application and should be independently investigated:

• Hardware and software upgrades: Upgrade computational resources, such...