Old is gold – REST API-based microservices
Old is gold. Plus, it's better to start somewhere where there are various API protocols. The Representational State Transfer (REST) protocol has become a gold standard for many applications over the years, and it's not so very different for ML applications today. The majority of companies prefer developing their ML applications based on the REST API protocol.
A REST API or RESTful API is based on REST, an architectural method used to communicate mainly in web services development.
RESTful APIs are widely used; companies such as Amazon, Google, LinkedIn, and Twitter use them. Serving our ML models via RESTful APIs has many benefits, such as the following:
- Serve predictions on the fly to multiple users.
- Add more instances to scale up the application behind a load balancer.
- Possibly combine multiple models using different API endpoints.
- Separate our model operating environment from the user...