خطوط البيانات مع AWS: أنشئ خط بيانات في الوقت الفعلي

This 60-minute guided project aims to teach data engineers how to create a comprehensive real-time data pipeline using AWS services. The project is of intermediate level and provides hands-on experience in data streaming, processing, and storage by building a real-time data pipeline, as well as learning best practices for designing and implementing cost-effective data engineering solutions on AWS using AWS Kinesis, Lambda, and Amazon S3.

Intended for data engineers looking to learn data pipelines, the project covers merging data from various sources into a common destination, enabling quick data analysis for business insights. Participants will build a real-time data streaming system for a commercial company, aiming to stream stock data such as prices and deliver it to the company's clients for informed decision-making.

• Pushing data from Lambda functions to Kinesis data streams
• Consuming data from the stream for reading, storing, or processing

This project requires a basic understanding of JavaScript concepts such as data types, loops, and functions, as well as familiarity with essential data pipeline steps like transformation, enrichment, filtering, and aggregation.