Serverless patterns for data ingestion
We will start by answering the question, What is serverless computing? Serverless computing is a cloud execution model in which a cloud provider takes care of allocating resources such as storage and compute based on demand while taking care of the servers on behalf of customers. Serverless computing removes the burden of maintaining and managing servers and resources associated with it. Here, the customers of serverless computing don’t care how and where the jobs or applications are running. They just focus on the business logic and let the cloud provider take care of managing the resources for running and executing that code. A few examples of serverless computing are as follows:
- AWS Lambda Function or Azure Function: This is used to run any application or service
- AWS Glue: This is used to run big data-based ETL jobs
- AWS Kinesis: This is a serverless event streaming and analytics platform
Although there are many...
