Streaming Concepts

Start Free Preview

Buying via our links supports this free directory · Affiliate disclosure.
Course facts
  • Payment: Free Preview (Paid Upgrade)
  • Learning style: Self-paced, start anytime
  • Format: Text & Interactive
  • Video access: Streaming Only
  • Before you start: Understanding Data Engineering
DataCamp details
  • Chapters: 4
Created byDataCamp
Available onDataCamp

Course Details
Learning Style

Start Anytime

Level

Beginner

Study Mode

100% Online

Duration

Short (< 10 Hours)

Languages
Audio Language

English

Outcomes
Certificate

Certificate of Completion

Price & Terms
Pricing Model

Free Preview (Paid Upgrade)

Technical
Content Medium

Text & Interactive

Video Access

Streaming Only

Specification
Access

Subscription

SKU: streaming-concepts Category: Tags: , Brand:

Learn how batch processing, queues and stream processing differ, how streaming systems scale, and how they apply to real use cases, in short exercises.

At a glance
Duration2 hrs
LevelBeginner
CertificateCertificate of Completion
LanguageEnglish
Taught byMike Metzger
AccessSubscription
Add your review
Add to wishlistAdded to wishlistRemoved from wishlist 0
Add to compare

Data pipelines can collect records and work through them on a schedule, hold them in a queue, or handle each event the moment it arrives, and that choice shapes how a system grows and where it breaks. The lessons compare batch, queue and stream processing, show how event-based computing and log streams behave, and look at the scaling choices and service levels that real-time pipelines must meet, with examples drawn from a music service, sensor data and a vaccination clinic.

What You Will Achieve

  • Decide whether a given workload is better handled in batches, through a queue, or as a stream
  • Judge when to scale a processing system vertically and when to scale it horizontally
  • Recognize ordering problems and other common issues before they disrupt a batch or streaming pipeline
  • Reason through the design of a streaming setup for a real case, including the service levels it must meet


Program Overview

Batch Data Processing

Starts with how batch jobs are put together and ordered, how they grow with more data, and where they run into trouble.

  • Batch characteristics and ordering
  • Scaling batch processing
  • Batch problems and typical scenarios

Event-Based Computing and Queuing

Introduces events as the unit of work and sets queues and single-system log streams against traditional batch jobs.

  • Event-based data processing
  • Queue characteristics and when to queue
  • Log stream order and log options
  • Batching compared with streaming

Real-Time Streaming Systems and Use Cases

Covers how modern streaming systems grow and what goes wrong in them, then applies the ideas to three worked cases.

  • Scaling up and scaling out
  • SLA guarantees and streaming roadblocks
  • Popular streaming systems and message components
  • Music service, sensor data and vaccination clinic cases

Certificate Awarded (Paid)


Job Outlook

Batch and streaming concepts underpin data engineering work, where teams design and run pipelines that handle event data such as sensor readings, application logs and activity from a music service.


Our take

Good for: Learners starting out in data engineering who want a clear vocabulary for batch jobs, queues and event streams before picking up a specific streaming tool.

Keep in mind: It is a concept course built on short interactive exercises with no coding, so it names popular streaming systems without teaching any of them hands-on.

Bottom line: Three worked cases, a music service, sensor data and a vaccination clinic, give the batch-versus-stream comparison practical footing.

Frequently Asked Questions

Does the course involve writing code?

No. The lessons teach the ideas through short interactive exercises, such as sorting cases into batch, queue or stream and classifying areas of a clinic scenario, so there is no code to write.

How do batching, queuing and streaming differ here?

Batch processing gathers data and works through it in chunks at set points, while stream processing deals with each event as it happens. Queuing is treated as a third option with its own characteristics, and the second chapter asks you when to queue and when to choose one of the other two.

Which real-world scenarios does the final chapter use?

It works through three cases: a streaming music service, where you look at the parts of a message; a sensor data setup, where service levels and scaling come up; and a vaccination clinic, where you classify areas and then handle a new problem.

User Reviews

0.0 out of 5
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0

No reviews yet. Be the first to review this course.

There are no reviews yet.

Write your review

Reviews can only be posted by registered learners. Log in, then you will return here to post.

×

    Report this page
    LiveTalent
    Logo
    Compare items
    • Total (0)
    Compare
    0