Software and Computer Engineering

Challenges in Data-Intensive Applications

Most web-based applications and systems we interact with daily are not CPU-bound, meaning the latency that we experience is not due to a huge amount of data being crunched.

Instead, latency can be usually attributed to the time it takes to get all the required data needed to fulfill a request, or for completing required data manipulation operations.

Kleppmann call those data-intensive applications, where the primary technical challenge is dealing with the data.

Still, this challenge can come in many forms: