• Onboard For Tech Teams

    • Reduce initial time to productivity.
    • Increase employee tenure.
    • Plug-and-play into HR onboarding and career pathing programs.
    • Customize for ad-hoc and cohort-based hiring approaches.

    Learn more
  • Upskill For Tech Teams

    • Upgrade and round out developer skills.
    • Tailor to tech stack and specific project.
    • Help teams, business units, centers of excellence and corporate tech universities.

    Learn more
  • Reskill For Tech Teams

    • Offer bootcamps to give employees a running start.
    • Create immersive and cadenced learning journeys with guaranteed results.
    • Supplement limited in-house L&D resources with all-inclusive programs to meet specific business goals.

    Learn more
  • Design For Tech Teams

    • Uplevel your existing tech learning framework.
    • Extend HR efforts to provide growth opportunities within the organization.
    • Prepare your team for an upcoming tech transformation.

    Learn more

Data Architecture Fundamentals

Get your team started on a custom learning journey today!

Our Boulder, CO-based learning experts are ready to help!

Get A Quote!

Course Summary

Home > Courses >Big Data Training >Data Engineering >Data Architecture Fundamentals

The Data Architecture Fundamentals training course covers concepts around creating an architecture that ensures speed, reliability, and security. 

The course begins by focusing on data sources and collections and how to transform data. Next, the course covers areas of storage, extraction, transformation, and loading into databases to make it easier for analysts to gain deep data insights. The course concludes with a lesson on Design Patterns in Data Engineering Architecture.

Purpose
Learn techniques and tools for data collection, usage, processing, storage, and integration with different systems.
Audience
Data Analysts, DBAs, Systems Administrators, and Developers that want to level up their ETL skills.
Role
Data Engineer - Data Scientist - Software Developer - System Administrator
Skill Level
Introduction
Style
Workshops
Duration
5 Days
Related Technologies
Download
imgprinter
  • Productivity Objectives:
    • Manage data well. 
    • Design flexible data management and integration systems. 
    • Create a real-time data environment. 
    • Secure your architecture. 
    • Employ data as a service.
Learn About Virtual Training

Request Information

Get your team upskilled or reskilled today. Chat with one of our experts to create a custom training proposal. Fully customized at no additional cost.

100secure

If you are not completely satisfied with your training class, we'll give you your money back.

secure100 secure100 secure100 secure100

about our training

  • keywordicon1
    Real-World Content

    Project-focused demos and labs using your tool stack and environment, not some canned "training room" lab.

  • keywordicon2
    Expert Practitioners

    Industry experts with 15+ years of industry experience that bring their battle scars into the classroom.

  • keywordicon3
    Experiential Learning

    More coding than lecture, coupled with architectural and design discussions.

  • keywordicon4
    Fully Customized

    One-size-fits-all doesn't apply to training teams. That's where we come in!

What You'll Learn

In the Data Architecture Fundamentals training course, you'll learn:

  • Data Sources and Collection
    • Data from API
    • Data from Websockets
    • Data from file system (text, avro, csv, etc)
    • Data from (S)FTP
    • Data from cloud (bucketing)
    • Data from mounted drive
    • Data from SQL Database
    • Data from NOSQL Database
  • Transforming Data
    • Review of data formats and efficiencies
      • JSON
      • Avro
      • XML
      • Parquet
    • Consuming and transformation in stream:
      • Merges
      • Joins
      • Concatenations
      • Grouping of disparate data
      • Partitions
  • Tools Review
    • Python Pandas review
    • KSQL
    • Cloud solutions for in-stream transformation
    • Quick overview of other solutions:
      • Talend
      • Informatica
      • Pentaho
  • Storing Data
    • Considerations around design patterns
      • Replication
      • Replayability
      • Block Storage
      • Drive mounts
      • Data Lakes
    • Networking considerations:
      • VPC
      • Private/Public Ips
  • Design Patterns in Data Engineering Architecture
    • Collecting data:
      • Polling
      • Streaming
      • Batching
      • Event Driven architecture
    • Data Warehousing patterns
      • Enterprise Data Warehouses
      • Enriched and unenriched data patterns
      • Dimension and Fact Tables
      • Setting your schemas correctly
Real-world content

Project-focused demos and labs using your tool stack and environment, not some canned "training room" lab.

Expert Practitioners

Industry experts that bring their battle scars into the classroom.

Experiential Learning

More coding than lecture, coupled with architectural and design discussions.

Fully Customized

One-size-fits-all doesn't apply to training teams. That's where we come in!

Elite Instructor Program

We recently launched our internal Elite Instructor Program. The community driven instructor program is designed to support instructors in transforming students’ lives by consistently showing a world-class level of engagement, ability, and teaching prowess. Reach out today to learn more about our instructors.

Customized Technical Learning Solutions to Help Attract and Retain Talented Developers

Get In Touch
Talk to one of our Learning Solution Architects today

Let DI help you design solutions to onboard, upskill or reskill your software development organization. Fully customized. 100% guaranteed.

DevelopIntelligence leads technical and software development learning programs for Fortune 500 companies. We provide learning solutions for hundreds of thousands of engineers for over 250 global brands.

99statisfaction1 Educate learners using experienced practitioners.
pularsight Proven customization process is guaranteed.
budgetnewlogo We're a strategic partner, not just another vendor.

“I appreciated the instructor’s technique of writing live code examples rather than using fixed slide decks to present the material.”

VMware
vmware View more