This blog post focuses on the lessons we learned while building our batch data pipeline.

Grab designs fault-tolerant systems that can withstand failures allowing us to continuously provide our customers with the many services they expect from us.

In this article, we focus on TalariaDB, a distributed, highly available, and low latency time-series database that stores real-time data. For example, logs, metrics, and click streams generated by mobile apps and backend services that use Grab's Experimentation Platform SDK. It "stalks" the real-time data feed and only keeps the last one hour of data.

Grab designs fault-tolerant systems that can withstand failures allowing us to continuously provide our customers with the many services they expect from us.

At Grab, we practice chaos engineering by intentionally introducing failures in a service or component in the overall business flow. But the failed’ service is not the experiment’s focus. We’re interested in testing the services dependent on that failed service.