Scenario: Your team needs to process streaming data in real-time and perform various transformations before storing it in a database. Outline the key considerations and challenges involved in designing an efficient data transformation pipeline for this scenario.

Scalability and fault tolerance are critical considerations when designing a data transformation pipeline for processing streaming data in real-time. The system must be able to handle varying workloads and maintain reliability to ensure uninterrupted data processing.