Skip to main content

Building Streaming Data Analytics Solutions on AWS

Written by Gemma Corrado on . Posted in AWS Training, Training.

Building Streaming Data Analytics Solutions on AWS

current course dates can be found at the bottom of this page … company training available on request!

Course description

In this course, you will learn to build streaming data analytics solutions using AWS services, including Amazon Kinesis and Amazon Managed Streaming for Apache Kafka (Amazon MSK). Amazon Kinesis is a massively scalable and durable real-time data streaming service. Amazon MSK offers a secure, fully managed, and highly available Apache Kafka service. You will learn how Amazon Kinesis and Amazon MSK integrate with AWS services such as AWS Glue and AWS Lambda. The course addresses the streaming data ingestion, stream storage, and stream processing components of the data analytics pipeline. You will also learn to apply security, performance, and cost management best practices to the operation of Kinesis and Amazon MSK.

 

Course objectives

In this course, you will learn to:

  • Understand the features and benefits of a modern data architecture. Learn how AWS streaming services fit into a modern data architecture
  • Design and implement a streaming data analytics solution
  • Identify and apply appropriate techniques, such as compression, sharding, and partitioning, to optimize data storage
  • Select and deploy appropriate options to ingest, transform, and store real-time and near real-time data
  • Choose the appropriate streams, clusters, topics, scaling approach, and network topology for a particular business use case
  • Understand how data storage and processing affect the analysis and visualization mechanisms needed to gain actionable business insights
  • Secure streaming data at rest and in transit
  • Monitor analytics workloads to identify and remediate problems
  • Apply cost management best practices

Intended audience

This course is intended for:

  • Data engineers and architects
  • Developers who want to build and manage real-time applications and streaming data analytics solutions

Prerequisites

We recommend that attendees of this course have:

  • At least one year of data analytics experience or direct experience building real-time applications or streaming analytics solutions. We suggest the Streaming Data Solutions on AWS whitepaper for
    those that need a refresher on streaming concepts.
  • Completed either Architecting on AWS or Data Analytics Fundamentals
  • Completed Building Data Lakes on AWS

Activities

This course includes:

  • presentations
  • practice labs
  • discussions
  • class exercises

Course duration / Price

  • 1 Day
  • € 750.00 (excl. tax) per person (DE)

Course outline

This course covers the following concepts:

Module A: Overview of Data Analytics and the Data Pipeline

  • Data analytics use cases
  • Using the data pipeline for analytics

Module 1: Using Streaming Services in the Data Analytics Pipeline

  • The importance of streaming data analytics
  • The streaming data analytics pipeline
  • Streaming concepts

Module 2: Introduction to AWS Streaming Services

  • Streaming data services in AWS
  • Amazon Kinesis in analytics solutions
  • Demonstration: Explore Amazon Kinesis Data Streams
  • Practice Lab: Setting up a streaming delivery pipeline with Amazon Kinesis
  • Using Amazon Kinesis Data Analytics
  • Introduction to Amazon MSK
  • Overview of Spark Streaming

Module 3: Using Amazon Kinesis for Real-time Data Analytics

  • Exploring Amazon Kinesis using a clickstream workload
  • Creating Kinesis data and delivery streams
  • Demonstration: Understanding producers and consumers
  • Building stream producers
  • Building stream consumers
  • Building and deploying Flink applications in Kinesis Data Analytics
  • Demonstration: Explore Zeppelin notebooks for Kinesis Data Analytics
  • Practice Lab: Streaming analytics with Amazon Kinesis Data Analytics and Apache Flink

Module 4: Securing, Monitoring, and Optimizing Amazon Kinesis

  • Optimize Amazon Kinesis to gain actionable business insights
  • Security and monitoring best practices

Module 5: Using Amazon MSK in Streaming Data Analytics Solutions

  • Use cases for Amazon MSK
  • Creating MSK clusters
  • Demonstration: Provisioning an MSK Cluster
  • Ingesting data into Amazon MSK
  • Practice Lab: Introduction to access control with Amazon MSK
  • Transforming and processing in Amazon MSK

Module 6: Securing, Monitoring, and Optimizing Amazon MSK

  • Optimizing Amazon MSK
  • Demonstration: Scaling up Amazon MSK storage
  • Practice Lab: Amazon MSK streaming pipeline and application deployment
  • Security and monitoring
  • Demonstration: Monitoring an MSK cluster

Module 7: Designing Streaming Data Analytics Solutions

  • Use case review
  • Class Exercise: Designing a streaming data analytics workflow

Module B: Developing Modern Data Architectures on AWS

  • Modern data architectures

 

IMPORTANT: Please bring your notebook (Windows, Linux or Mac) to our trainings. If this is not possible, please contact us in advance.

Course materials are in English, on request also in German (if available).
Course language is German, on request also in English.

Building Batch Data Analytics Solutions on AWS

Written by Gemma Corrado on . Posted in AWS Training, Training.

Building Batch Data Analytics Solutions on AWS

current course dates can be found at the bottom of this page … company training available on request!

Course description

In this course, you will learn to build batch data analytics solutions using Amazon EMR, an enterprise-grade Apache Spark and Apache Hadoop managed service. You will learn how Amazon EMR integrates with open-source projects such as Apache Hive, Hue, and HBase, and with AWS services such as AWS Glue and AWS Lake Formation. The course addresses data collection, ingestion, cataloging, storage, and processing components in the context of Spark and Hadoop. You will learn to use EMR Notebooks to support both analytics and machine learning workloads. You will also learn to apply security, performance, and cost management best practices to the operation of Amazon EMR.

Course objectives

In this course, you will learn to:

  • Compare the features and benefits of data warehouses, data lakes, and modern data architectures
  • Design and implement a batch data analytics solution
  • Identify and apply appropriate techniques, including compression, to optimize data storage
  • Select and deploy appropriate options to ingest, transform, and store data
  • Choose the appropriate instance and node types, clusters, auto scaling, and network topology for a particular business use case
  • Understand how data storage and processing affect the analysis and visualization mechanisms needed to gain actionable business insights
  • Secure data at rest and in transit
  • Monitor analytics workloads to identify and remediate problems
  • Apply cost management best practices

Intended audience

This course is intended for:

  • Data platform engineers
  • Architects and operators who build and manage data analytics pipelines

Prerequisites

We recommend that attendees of this course have:

Activities

This course includes:

  • Training with instructor
  • Practical exercises

Course duration / Price

  • 1 day / € 795.00 (excl. tax) per person (DE)

Course outline

Module A: Overview of Data Analytics and the Data Pipeline

  • Data analytics use cases
  • Using the data pipeline for analytics

Module 1: Introduction to Amazon EMR

  • Using Amazon EMR in analytics solutions
  • Amazon EMR cluster architecture
  • Interactive Demo 1: Launching an Amazon EMR cluster
  • Cost management strategies

Module 2: Data Analytics Pipeline Using Amazon EMR: Ingestion and Storage

  • Storage optimization with Amazon EMR
  • Data ingestion techniques

Module 3: High-Performance Batch Data Analytics Using Apache Spark on Amazon EMR

  • Apache Spark on Amazon EMR use cases
  • Why Apache Spark on Amazon EMR
  • Spark concepts
  • Interactive Demo 2: Connect to an EMR cluster and perform Scala commands using the Spark shell
  • Transformation, processing, and analytics
  • Using notebooks with Amazon EMR
  • Practice Lab 1: Low-latency data analytics using Apache Spark on Amazon EMR

Module 4: Processing and Analyzing Batch Data with Amazon EMR and Apache Hive

  • Using Amazon EMR with Hive to process batch data
  • Transformation, processing, and analytics
  • Practice Lab 2: Batch data processing using Amazon EMR with Hive
  • Introduction to Apache HBase on Amazon EMR

Module 5: Serverless Data Processing

  • Serverless data processing, transformation, and analytics
  • Using AWS Glue with Amazon EMR workloads
  • Practice Lab 3: Orchestrate data processing in Spark using AWS Step Functions

Module 6: Security and Monitoring of Amazon EMR Clusters

  • Securing EMR clusters
  • Interactive Demo 3: Client-side encryption with EMRFS
  • Monitoring and troubleshooting Amazon EMR clusters
  • Demo: Reviewing Apache Spark cluster history

Module 7: Designing Batch Data Analytics Solutions

  • Batch data analytics use cases
  • Activity: Designing a batch data analytics workflow

Module B: Developing Modern Data Architectures on AWS

  •  Modern data architectures

IMPORTANT: Please bring your notebook (Windows, Linux or Mac) to our trainings. If this is not possible, please contact us in advance.

Course materials are in English, on request also in German (if available).
Course language is German, on request also in English.

AWS Security Essentials

Written by wamrhein on . Posted in AWS Training, Training.

  • Aws Advanced Training Partner

  • Aws Premium Consuting Partner

AWS Security Essentials

current course dates can be found at the bottom of this page … company training available on request!

Course description

This course covers fundamental AWS cloud security concepts, including AWS access control, data encryption methods, and how network access to your AWS infrastructure can be secured. Based on the AWS Shared Security Model, you learn where you are responsible for implementing security in the AWS Cloud and what security-oriented services are available to you and why and how the security services can help meet the security needs of your organization.

Course objectives

In this course, you will learn to:

  • Assimilate Identify security benefits and responsibilities of using the AWS Cloud
  • Describe the access control and management features of AWS
  • Explain the available methods for providing encryption of data in transit and data at rest when storing your data in AWS.
  • Describe how to secure network access to your AWS resources
  • Determine which AWS services can be used for monitoring and incident response

Intended audience

This course is intended for:

  • Security IT business-level professionals interested in cloud security practices
  • Security professionals with minimal to no working knowledge of AWS

Prerequisites

We recommend that attendees of this course have:

  • Working knowledge of IT security practices and infrastructure concepts, familiarity with cloud computing concepts

Activities

This course includes:

  • presentations
  • hands-on labs

Course duration / Price

  • 1 Day
  • € 895.00 (excl. tax) per person (DE)
  • CHF 900.00 (excl. tax) per person (CH)

Course outline

Day 1

  • Module 1: Security on AWS
    • Security design principles in the AWS Cloud
    • AWS Shared Responsibility Model
  • Module 2: Security OF the Cloud
    • AWS Global Infrastructure
    • Data center security
    • Compliance and governance
  • Module 3: Security IN the Cloud – Part
    • Identity and access management
    • Data protection essentials
    • Lab 01 – Introduction to security policies
  • Module 4: Security IN the Cloud – Part 2
    • Securing your infrastructure
    • Monitoring and detective controls
    • Lab 02 – Securing VPC resources with Security Groups
  • Module 5: Security IN the Cloud – Part 3
    • DDoS mitigation
    • Incident response essentials
    • Lab 03 – Remediating issues with AWS Config Conformance Packs
  • Module 6: Course Wrap Up
    • AWS Well-Architected tool overview
    • Next Steps

IMPORTANT: Please bring your notebook (Windows, Linux or Mac) to our training. If this is not possible, please contact us in advance.

Course materials are in English, on request also in German (if available).
The course language is German, on request also in English.

Neue Termine in Planung!

Continue reading

MLOps Engineering on AWS

Written by wamrhein on . Posted in AWS Training, Training.

MLOps Engineering on AWS

current course dates can be found at the bottom of this page … company training available on request!

Course description

This course builds upon and extends the DevOps practice prevalent in software development to build, train, and deploy machine learning (ML) models. The course stresses the importance of data, model, and code to successful ML deployments. It will demonstrate the use of tools, automation, processes, and teamwork in addressing the challenges associated with handoffs between data engineers, data scientists, software developers, and operations. The course will also discuss the use of tools and processes to monitor and take action when the model prediction in production starts to drift from agreed-upon key performance
indicators.

The instructor will encourage the participants in this course to build an MLOps action plan for their organization through daily reflection of lesson and lab content, and through conversations with peers and instructors.

Course objectives

In this course, you will learn to:

  • Describe machine learning operations
  • Understand the key differences between DevOps and MLOps
  • Describe the machine learning workflow
  • Discuss the importance of communications in MLOps
  • Explain end-to-end options for automation of ML workflows
  • List key Amazon SageMaker features for MLOps automation
  • Build an automated ML process that builds, trains, tests, and deploys models
  • Build an automated ML process that retrains the model based on change(s) to the model code
  • Identify elements and important steps in the deployment process
  • Describe items that might be included in a model package, and their use in training or inference
  • Recognize Amazon SageMaker options for selecting models for deployment, including support for ML frameworks and built-in algorithms or bring-your-own-models
  • Differentiate scaling in machine learning from scaling in other applications
  • Determine when to use different approaches to inference
  • Discuss deployment strategies, benefits, challenges, and typical use cases
  • Describe the challenges when deploying machine learning to edge devices
  • Recognize important Amazon SageMaker features that are relevant to deployment and inference
  • Describe why monitoring is important
  • Detect data drifts in the underlying input data
  • Demonstrate how to monitor ML models for bias
  • Explain how to monitor model resource consumption and latency
  • Discuss how to integrate human-in-the-loop reviews of model results in production

Intended audience

This course is intended for:

  • DevOps Engineers
  • ML Engineers
  • Developers/operations with responsibility for operationalizing ML models

Prerequisites

We recommend that attendees of this course have:

Activities

This course includes:

  • Training with instructor
  • Practical exercises

Course duration / Price

  • 3 days / € 2,685.00 (excl. tax) per person (DE)

Course outline

Module 1: Security on AWS

  • Machine learning operations
  • Goals of MLOps
  • Communication
  • From DevOps to MLOps
  • ML workflow
  • Scope
  • MLOps view of ML workflow
  • MLOps cases

Module 2: MLOps Development

  • Intro to build, train, and evaluate machine learning models
  • MLOps security
  • Automating
  • Apache Airflow
  • Kubernetes integration for MLOps
  • Amazon SageMaker for MLOps
  • Lab: Bring your own algorithm to an MLOps pipeline
  • Demonstration: Amazon SageMaker
  • Lab: Code and serve your ML model with AWS CodeBuild
  • Activity: MLOps Action Plan Workbook

Module 3: MLOps Deployment

  • Introduction to deployment operations
  • Model packaging
  • Inference
  • Lab: Deploy your model to production
  • SageMaker production variants
  • Deployment strategies
  • Deploying to the edge
  • Lab: Conduct A/B testing
  • Activity: MLOps Action Plan Workbook

Module 4: Model Monitoring and Operations

  • Lab: Troubleshoot your pipeline
  • The importance of monitoring
  • Monitoring by design
  • Lab: Monitor your ML model
  • Human-in-the-loop
  • Amazon SageMaker Model Monitor
  • Demonstration: Amazon SageMaker Pipelines, Model Monitor, model registry, and Feature Store
  • Solving the Problem(s)
  • Activity: MLOps Action Plan Workbook

Module 5: Wrap-up

  • Course review
  • Activity: MLOps Action Plan Workbook
  • Wrap-up

IMPORTANT: Please bring your notebook (Windows, Linux or Mac) to our trainings. If this is not possible, please contact us in advance.

Course materials are in English, on request also in German (if available).
Course language is German, on request also in English.

Building Data Analytics Solutions Using Amazon Redshift

Written by wamrhein on . Posted in AWS Training, Training.

Building Data Analytics Solutions Using Amazon Redshift

current course dates can be found at the bottom of this page … company training available on request!

Course description

In this course, you will build a data analytics solution using Amazon Redshift, a cloud data warehouse service. The course focuses on the data collection, ingestion, cataloging, storage, and processing components of the analytics pipeline. You will learn to integrate Amazon Redshift with a data lake to support both analytics and machine learning workloads. You will also learn to apply security, performance, and cost management best practices to the operation of Amazon Redshift.

Course objectives

In this course, you will learn to:

  • Compare the features and benefits of data warehouses, data lakes, and modern data architectures
  • Design and implement a data warehouse analytics solution
  • Identify and apply appropriate techniques, including compression, to optimize data storage
  • Select and deploy appropriate options to ingest, transform, and store data
  • Choose the appropriate instance and node types, clusters, auto scaling, and network topology for a particular business use case
  • Understand how data storage and processing affect the analysis and visualization mechanisms needed to gain actionable business insights
  • Secure data at rest and in transit
  • Monitor analytics workloads to identify and remediate problems
  • Apply cost management best practices

Intended audience

This course is intended for:

  • Data Warehouse Engineers
  • Data Platform Engineers
  • Architects and Operators who build and manage data analytics pipelines

Prerequisites

We recommend that attendees of this course have:

Activities

This course includes:

  • Training with instructor
  • Practical exercises

Course duration / Price

  • 1 day / € 750.00 (excl. tax) per person (DE)

Course outline

Module A: Overview of Data Analytics and the Data Pipeline

  • Data analytics use cases
  • Using the data pipeline for analytics

Module 1: Using Amazon Redshift in the Data Analytics Pipeline

  •  Why Amazon Redshift for data warehousing?
  • Overview of Amazon Redshift

Module 2: Introduction to Amazon Redshift

  • Amazon Redshift architecture
  • Interactive Demo 1: Touring the Amazon Redshift console
  • Amazon Redshift features
  • Practice Lab 1: Load and query data in an Amazon Redshift cluster

Module 3: Ingestion and Storage

  • Ingestion
  • Interactive Demo 2: Connecting your Amazon Redshift cluster using a Jupyter notebook with Data API
  • Data distribution and storage Interactive Demo 3: Analyzing semi-structured data using the SUPER data type
  • Querying data in Amazon Redshift
  • Practice Lab 2: Data analytics using Amazon Redshift Spectrum

Module 4: Processing and Optimizing Data

  • Data transformation
  • Advanced querying Practice Lab 3: Data transformation and querying in Amazon Redshift
  • Resource management
  • Interactive Demo 4: Applying mixed workload management on Amazon Redshift
  • Automation and optimization
  • Interactive demo 5: Amazon Redshift cluster resizing from the dc2.large to ra3.xlplus cluster

Module 5: Security and Monitoring of Amazon Redshift Clusters

  • Securing the Amazon Redshift cluster
  • Monitoring and troubleshooting Amazon Redshift clusters

Module 6: Designing Data Warehouse Analytics Solutions

  • Data warehouse use case review
  • Activity: Designing a data warehouse analytics workflow

Module B: Developing Modern Data Architectures on AWS

  • Modern data architectures

IMPORTANT: Please bring your notebook (Windows, Linux or Mac) to our trainings. If this is not possible, please contact us in advance.

Course materials are in English, on request also in German (if available).
Course language is German, on request also in English.