Linkedin just deprecated Kafka in favor of Northguard [1]. Curious how this actually compares in practice. Is it worth the effort of building yet another distributed log? Is it worth the effort to mantain Kafka if new alternatives are popping? Jepsen found plenty of issues last year [2], so maybe Linkedin is in the right direction by building from scratch...
Distributed systems are tough to get right, and while it's exciting to see new approaches, the space is definitely getting harder to follow.
Linkedin just deprecated Kafka in favor of Northguard [1]. Curious how this actually compares in practice. Is it worth the effort of building yet another distributed log? Is it worth the effort to mantain Kafka if new alternatives are popping? Jepsen found plenty of issues last year [2], so maybe Linkedin is in the right direction by building from scratch...
Distributed systems are tough to get right, and while it's exciting to see new approaches, the space is definitely getting harder to follow.
[1] https://www.linkedin.com/blog/engineering/infrastructure/int...
[2] https://jepsen.io/analyses/bufstream-0.1.0