AI and Digital TransformationData Engineering and Analytics Pipelines
Analytics fails far more often on the pipeline than on the model, because data arrives late, arrives changed, or silently stops arriving and nobody notices for a fortnight. This course covers building pipelines that hold. Delegates work through source systems and extraction patterns including change capture, the loading and transformation choices behind a warehouse or a lake, and modelling data for analysis rather than for transactions. Orchestration, scheduling and dependency management are covered. Testing, monitoring and alerting on data are treated as first class concerns. Handling schema change and backfills follows. The course closes on cost, on documentation and on handing a pipeline to somebody else.
Course objectives
- Extract from source systems including change data capture
- Choose between transformation approaches for a warehouse or lake
- Model data for analysis rather than for transactions
- Orchestrate schedules and manage dependencies
- Test and monitor data so silent failures are noticed
- Handle schema change and run backfills safely
- Control cost and document a pipeline for handover
Who should attend
- Data engineers and analytics developers
- Database administrators moving into analytics
- Analysts maintaining their own data flows
- IT staff supporting reporting platforms
- Technical leads designing data architecture
Course outline
- 01Pipelines fail more often than models
- 02Source systems and extraction patterns
- 03Change data capture
- 04Loading, transformation and storage choices
- 05Modelling data for analysis
- 06Orchestration and dependencies
- 07Testing, monitoring and alerting on data
- 08Schema change, backfills, cost and handover
Scheduled sessions
| Dates | Venue | Format | Price | Register |
|---|---|---|---|---|
| 21 to 25 September 2026 | Accra, Ghana | Classroom | USD 1,325 per delegate | Register Now |
| 26 to 30 October 2026 | Lusaka, Zambia | Classroom | USD 1,325 per delegate | Register Now |
| 1 to 5 February 2027 | Online | Online | R8,500 per delegate | Register Now |
| 8 to 12 February 2027 | Harare, Zimbabwe | Classroom | USD 1,325 per delegate | Register Now |