AWS Landing Zone-Transformation Day October 2017 ... AWS

Report 15 Downloads 12 Views
LONDON

Simplify & Standardise Your Migration to AWS with a Migration Landing Zone Koen vd Biggelaar - Sr Mgr AWS Solutions Architecture Mahmoud ElZayet – Solutions Builder

Tuesday 31st October 2017

Planning a Migration? Key Questions to consider

What are our key drivers

How do we configure our AWS environment

How do we develop a business case

What are best practices for Security and Compliance

What is our application portfolio

Which partners are we going to use ?

What types of migration will we use

How do we build a Cloud Operating Model

What is an AWS Landing Zone? - A baseline secure multi-account AWS environment configured based on best practices

H

- A starting point for your application migration journey - An environment that allows for iteration & extension over time

What to Expect from the Session

H

Understand

Engage

Build

Operate

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AWS Cloud Adoption Framework

Application Migration

H

Create Landing Zone

Migrate Apps

Operate & Optimise

Landing Zone Journey Logging

Config

Imaging

Access

Identities

Federation Migrate

Start

Accounts

Network

Security

Identity & Operational Automation Access

What’s Next ?

Iterate

Operate & Optimise Domains

Direct Connect

Central Services

Service Catalog

Automation

End User Interaction

Current State Typical Enterprise Situation

Lines of Business Infrastructure Request Central IT Governance & Service Management

Provisioning

Characteristics • • •

Lead times ~days to weeks Service catalogue of components Often process-heavy service management

Agility versus Control How to choose?

I need control, so I can protect our business

We want agility, so we can innovate in our business

Business & Business IT

?

Central IT

Current State Opportunity to achieve Agility and Control Landing Zone Lines of Business

Landscape Management

Templates Policy & Best Practices

Automation

Central IT

Opportunities • •

Monitor & Respond



Lead times in minutes Service catalogue of landscapes Automated service management

Guiding Principles

Security

Landscapes & Automation

Cloud IT Consumers

Start

Accounts

Network

Security

Identity & Access

Operational Automation

What’s Next ?

Account Structure •

Don’t overdo on Day One



Use separate accounts for:

Cost Allocation

Resource Management and Ownership

Security and Compliance Isolation (production non-prod, logging)

Account Structure Billing Central Accounts

Security and Audit

Application Accounts

Production Generic

Production Critical

Shared Services

Dev & Test

Dev & Test

Business Apps Option: Per AWS Region

Analytics IoT Mobile Digital Platforms

Initial Account Structure Different Perspectives Security & Audit Account Billing Account

Consolidated Billing

Shared Services Account

Billing Account

Logs

Application Account(s)

Billing Account Structure

VPC Peering

Security & Audit Account Application Account(s)

Shared Services Account Structure

Application Account(s)

Security & Audit Account Structure Billing

Billing Account Shared Services Account

Shared Services Account

Security & Audit Account

Application Account(s)

Logs

Peering

Billing Account Security & Audit Account Shared Services Account

Application Account Structure

Manage Multiple Accounts CloudFormation StackSets Payer / Adminstrator Account

Stack Set

Template

Target Account: A

Stack Account C

Target Account: A

Target Account: B

Stack

Stack

Account D Region

Account E

Target Account: B



Account C

Stack

Account D Region

Account E



Manage Multiple Accounts AWS Organizations Root Lookup Stack Set

OU

Deploy

Account A

OU

OU

OU Stack Set

Account B

Account C

Start

Accounts

Network

Security

Identity & Access

Operational Automation

What’s Next ?

Individual VPC Patterns ü Hybrid 2-tier (public and private) ü Internal-only ü Internet-only ü Hybrid 3-tier (Presentation/Application/Data) AWS Quick Start: Scalable VPC PCI DSS

Multiple VPN/DX VIFs Connect Applications running in multiple VPC to your DC

§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§§§§§§§§

AWS Answers: How do I connect multiple VPCs in a single AWS Region?

ü Leverage existing AWS Direct Connect to route traffic between VPCs ü Offers customers the ability to incorporate transitive routing ü Need to create more than 100 connections per VPC

Multi-VPC Partially Meshed VPC Peering §§§§§§§§§§§ §§§§§§§§§§§ §§§§§§§§§§§ §§§§§§§§§§§ §§§§§§§§§§§ §§§§§§§§§§§ §§§§§§§§§§§ §§§§§§§§§§§ §§

ü Can create multiple VPCs within the same or different region/account ü Do not require full connectivity between all of their VPCs ü Central shared services VPC ü Multiple VPCs that need access to shared resources but do not each other ü Require fewer than 100 peering connections per VPC

AWS Answers: How do I share a single VPN connection with multiple VPCs?

Transit VPC

§§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§

AWS Answers: How do I build a global transit network on AWS?

ü Uses customer-managed EC2 VPN instances in a dedicated transit VPC with an IGW ü Implements a transit VPC ü Want more advanced connection types, such as inter-region connectivity, or multi-VPC connectivity to on-premises resources

Start

Accounts

Network

Security

Identity & Access

Operational Automation

What’s Next ?

Set Per-Account Security Baseline Configuration of the security baseline Access Control AWS Identity and Access Management (IAM) IAM password and other policies

Billing Account

AWS Organizations

Shared Services

Amazon VPC

AWS AWS Directory Service Catalog Service

Auditing and Governance AWS Config Centrally store configuration changes AWS CloudTrail

Application Accounts Application Accounts Application Accounts Application Accounts

Security Log Account

Centrally store audit logs Amazon S3 bucket (security logs)

Security Notifications AWS CloudWatch Alerts Alert and send security notifications

AWS Labs Github: aws-config-rules AWS Quick Start: quickstart-compliance-common (Github)

Build Compliance into your AWS accounts • • •

Implement the CIS Foundations Benchmark Use the UK-OFFICIAL compliance Quick Start Deploy the AWS Labs CIS Foundation Benchmark Checklist templates

§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§§§§§§§§

AWS Labs Github: aws-security-benchmark

AWS Security Blog: Announcing Industry Best Practices for Securing AWS Resources

AWS Quick Start: UK-OFFICIAL

Log everything centrally for analysis AWS CloudTrail

Amazon EC2

Flow Logs VPC subnet

Log

Centralised logging makes it easy for security teams to consolidate AWS logs and analyze them to detect incidents

Amazon S3

Amazon CloudWatch

You can do this by simply using: Amazon Elasticsearch Service

AWS Lambda

Transform

Search

AWS Answers: How can I implement a centralized logging solution on AWS? What are the native AWS security-logging capabilities?

• • • • •

Amazon ElasticSearch Service CloudTrail logs VPC flow logs EC2 server logs AWS Config logs

Choose how to start your compute Private images or import your current ones User administration

Configure your environment as you like

Whitelisting and integrity

Options to create or import your own ‘gold’ images 1. 2. 3. 4.

Malware and IPS

Import existing VMs to AWS Procure partner AMI from AWS Marketplace Create and save your own custom images Bootstrapping a base AMI

Vulnerability management Audit and logging Hardening and configuration

Operating system

Launch instance

AMI catalogue

AWS Marketplace: CIS Hardened AMIs

EC2

Configure instance

Running instance

AWS Devops Blog: How to Create an AMI Builder with AWS CodeBuild and HashiCorp Packer

Your instance

Start

Accounts

Network

Security

Identity & Access

Operational Automation

What’s Next ?

Identity and Access Management Control access and segregate duties everywhere You get to control who can do what in your AWS environment when and from where Fine-grained control of your AWS cloud with multi-factor authentication Integrate with your existing corporate directory and provide SSO to your customers. Support for SAML 2.0 (like your existing Active Directory) and OpenID compatible Identity Providers (IdPs). You can use AWS managed policies, policies for typical job functions or customer-generated policies using the policy generator and test with the policy simulator AWS account owner

Identity and Access Management Identity Federation Identity and authentication

Identity Store

AD Group

Browser interface Corporate Data Center

Mapping to specific IAM role with access policy

Access to AWS

Select an Identity Federation Option

• • • •

Cross-Account Roles with IAM Cross-Account Roles with AWS Directory Service SAML Federation Custom Identity Broker

Example: Cross-Account Roles with AWS Directory Service §§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§ §§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§§ §§§§ switch role

users

AWS Directory Service

Shared-services account

Sub-accounts (Billing, Security, Application)



Users and groups are managed in one account (Shared-services) using AWS Directory Service



IAM roles in every account is used for fine-grained authorization



Can be integrated with on-premises user directory for authentication

AWS Answers: How do I manage multiple AWS accounts for security purposes?

Start

Accounts

Network

Security

Identity & Access

Operational Automation

What’s Next ?

Agility and Control AWS Service Catalog and Marketplace

Standardise Control Govern

Organizations

Agility Self-Service Time to Market

…allows organizations to create and manage catalogs of IT services and software on AWS

Developers

Key Features Tag Enforcement

Share Portfolios

Portfolio Level IAM access

Version & Re-use Products

Denial of end-user access to underlying services

API, CLI, Console

Constraint CloudFormation Parameters

AWS Marketplace to AWS Service Catalog Copy

AWS Ops Automator • Automation Framework • Central Administration • Multi-Account/Multi-Region • Pre-built Actions • Custom Actions (Auto-retry, logging, concurrency…etc.)

AWS Answers: https://aws.amazon.com/answers/infrastructure-management/ops-automator/

EC2 instance scheduler CloudWatch Logs

CloudWatch Metrics

CloudWatch rule triggers Scheduler

CloudFormation scheduler stack

A single template deploys all solution components

Tagged EC2 Scheduler role

Scheduler configuration table AWS Answers: How do I automatically start and stop my Amazon EC2 instances?/

EC2 Instance information

Scheduler Lambda function

Instance state table

instances for one or more AWS accounts

IAM cross account roles controls access to AWS accounts

What have we built so far? High-level Architecture

Stack Set Admin Account Stack Sets

CloudTrail, Config & IAM Baseline

Billing Account

Security Account

Centralised Logging Analytics

CAM SubAccount

Logging Buckets

Cost Optimization Monitor

VPC Flow & Instance Logs

Shared Services Account

Cross Account Manager

Stand Alone Templates

Scalable VPC Quick Start

Application Accounts

Ops Automator/ Instance Scheduler

Start

Accounts

Network

Security

Identity & Access

Operational Automation

What’s Next ?

Managing to the Portfolio Value

Portfolio Tier

Requirements

Operations Model

Approx. % Portfolio*

DevOps

15%

Differentiators

High rate of change & innovation; Possibly business-critical, but not always

Table Stakes

Business-critical, but low rate of change. Needs high availability, maximum reliability, and durable DR

Automated Efficiency

25%

Commodity

COTS & commodity, minimal risk, low change, standard downtime & reliability requirements

AutomatedTraditional

60%

60% - 70%

*estimated numbers

Provided Under NDA

IT Spend Against Portfolio

30% - 40%

Running Multi-Modal Migrations Mass migration

Maturity

Traditional Operations+

Re-platform / Refactor

Maturity

Automated Operations

Mass Migration

Capex to Opex

Cloud Capable Applications

Capex to Opex

Cost Out

Value Automation

Nascent Services

Operational Transition

Facilities Closure

Consistent Operations

Cloud COE

Managed Services

Increasing Levels of Effort with Increasing Levels of Return

Re-architect

Development and Operations Serverless Compute

Continuous Integration

Disruptive Technolog y

Cloud Aware Applications

Maximum Efficiency

Advanced Architecture

Executing Multi-Modal Migrations Sprint 1

Sprint 2 Sprint 3

Sprint 4

Sprint 5

Sprint 6

Sprint 7

Program

Deploy Landing Zone

Extend, Integrate and Manage Landing Zone Migration Business Case

Brown

Discovery Prep

Discovery Pipeline Generation

Migration Patterns Creation

Green

Discovery

Re-Host Re-Factor Complex App (single sprint) Greenfield Migrations Innovation

Key Take-Aways •

Configuring your AWS environment matching your operations and migration needs, is a key step in your cloud journey



Maximise automation, including cost optimization (i.e. resize instances, on-off schedules)



Check aws.amazon.com/answers for guidance and packaged solutions helping you to build your own Landing Zone



Be agile for your Migrations, not everything can be planned upfront

H

LONDON

Thank you!

Landing Zone Resources (1/3) Title

Link

Cost Optimization Monitor

https://aws.amazon.com/answers/account-management/cost-optimizationmonitor/

Scalable VPC Quick Start

https://docs.aws.amazon.com/quickstart/latest/vpc/

PCI DSS Quick Start

https://aws.amazon.com/quickstart/architecture/accelerator-pci/

How do I connect multiple VPCs in a single AWS Region?

https://aws.amazon.com/answers/networking/aws-single-region-multi-vpcconnectivity/

How do I share a single VPN connection with multiple VPCs?

https://aws.amazon.com/answers/networking/aws-multiple-vpc-vpnconnection-sharing/

How do I build a global transit network on AWS?

https://aws.amazon.com/answers/networking/aws-global-transit-network/

Microsoft Active Directory

https://aws.amazon.com/quickstart/architecture/active-directory-ds/

How do I ensure I set up my AWS account securely?

https://aws.amazon.com/answers/security/aws-secure-account-setup/

How do I setup AWS Identity and Account Management (IAM) for my organization?

https://aws.amazon.com/answers/security/aws-iam-in-practice/

Landing Zone Resources (2/3) Title

Link

Compliance Quick Start

https://github.com/aws-quickstart/quickstart-compliance-common

CIS Security Benchmark

https://github.com/awslabs/aws-security-benchmark

Security Blog: Announcing Industry Best Practices for Securing AWS Resources

https://aws.amazon.com/blogs/security/announcing-industry-best-practicesfor-securing-aws-resources/

UK-OFFICIAL Compliance Quick Start

https://aws.amazon.com/quickstart/architecture/accelerator-uk-official/

How can I implement a centralized logging solution on AWS?

https://aws.amazon.com/answers/logging/centralized-logging/

What are the native AWS security-logging capabilities?

https://aws.amazon.com/answers/logging/aws-native-security-loggingcapabilities/

CIS Hardened AMIs

https://aws.amazon.com/marketplace/seller-profile?id=6b3b0dc2-c6f4-487b8f29-9edba5f39eed

How to Create an AMI Builder with AWS CodeBuild and HashiCorp Packer

https://aws.amazon.com/blogs/devops/how-to-create-an-ami-builder-with-awscodebuild-and-hashicorp-packer/

How should I manage multiple AWS accounts for security purposes?

https://aws.amazon.com/answers/account-management/aws-multi-accountsecurity-strategy/

Landing Zone Resources (3/3) Title

Link

User Access Management Module

http://www.awslandingzone.com/modules/landing-zone-user-access.pptx

How do I monitor the cross-region replication of my Amazon S3 objects?

https://aws.amazon.com/answers/infrastructure-management/crr-monitor/

AWS Ops Automator

https://github.com/awslabs/aws-ops-automator

DynamoDB Continuous Backup Utility

https://github.com/awslabs/dynamodb-continuous-backup

How do I automatically start and stop my Amazon EC2 instances?

https://aws.amazon.com/answers/infrastructure-management/ec2-scheduler/

How do I receive notifications as I approach AWS service limits?

https://aws.amazon.com/answers/account-management/limit-monitor/

Deck Guidelines Fonts, sizes, colors, and layouts are all pre-built in this template. Color palette Please do not use gradients, shadows, or outlines on shape elements. Limit color use for chart graphics to grayscale plus one accent color.