SCST1133 · Topic 01

Hardware to Data Engineering

Connect sensors, edge devices, networks, servers and storage to a complete data workflow.

01Introduction to Computer and System
Course connection

Hardware to Data Engineering

Connect sensors, edge devices, networks, servers and storage to a complete data workflow.

Hardware supporting capture, processing, transfer, storage and data analysis
Figure 21. Data engineering depends on coordinated hardware across the complete data journey.

End-to-end data journey

Capture

Sensors and input devices create observations from physical events.

Process at the edge

Local hardware filters, validates or aggregates data close to its source.

Transfer

Gateways and networks move data using reliable and secure protocols.

Store and process

Servers, databases and data platforms retain and transform the data.

Analyse and act

Dashboards and applications turn processed data into decisions.