Kafka

LinkedIn portal will be the most used portal in your professional career. The Kafka system was first introduced by the LinkedIn technical team. LinkedIn built a software metrics tool using custom in-house components with minor support from existing open source tools. The system collected user activity data on the data portal. It also used this activity data to show relevant information to each user on the web portal. The system was originally built as a traditional XML-based logging service, that was processed with different extract transform load (ETL) tools. However, as this arrangement did not work, they started running into various problems. To solve these problems, they built a system called Kafka. LinkedIn built Kafka as a distributed, fault-tolerant, publish/subscribe system. It records messages organized into topics. Applications can produce or consume messages from...