Cancun MemoryLake
Cancun MemoryLake Deployment/Quick Start Guide for Controller using AMI on AWS
September, 2017
Installation Guide
Table of Contents INTRODUCTION
3
STEPS TO INSTANTIATE MEMORYLAKE
3
STEP 1: CHOOSE AMI
3
STEP 2: SET INSTANCE TYPE
4
STEP 3: SELECTING VPC GROUP AND SETTING IAM ROLE
4
STEP 4: SET ROOT VOLUME SIZE
5
STEP 5: ADD TAGS
5
STEP 6: SELECT SECURITY GROUP
6
STEP 7: REVIEW AND CLICK LAUNCH
7
CONFIGURE MEMORYLAKE USING CONTROLLER UI
9
STEP 1: ENTER LICENSE KEY
9
STEP 2: CHOOSE CLUSTER TYPE
9
STEP 3: CONFIGURE MEMNODE AND MEMORYLAKE CACHE
10
STEP 4: CHOOSE THE UNDERLAY FS TYPE
11
STEP 5: COMMIT CONFIGURATION
12
EC2 CLUSTER
12
CONCLUSION
13
Data Platform for Fast Insights
2
Installation Guide
Introduction This document details the steps to get Cancun’s MemoryLake instantiated on AWS using the AMI on AWS’s Market Place. For details on configuring and using MemoryLake, please refer to the detailed Installation guide.
Steps to Instantiate MemoryLake Step 1: Choose AMI Choose the Cancun AMI from the Marketplace as shown in the image below.
Please note, the Cancun Controller AMI does support 1-click. With 1-click the instance will get invoked with instance type t2.large.
Data Platform for Fast Insights
3
Installation Guide
Step 2: Set instance type When 1-click is not used you will then have to select the instance type and our recommendation is either a t2.large or an m3.large.
Step 3: Selecting VPC group and setting IAM role An IAM role must be attached with controller instance while launching the Memvisor AMI. Steps for creating an IAM role: a) Go to IAM Dashboard, click on 'Create new role' b) Select AWS Service Role as "Amazon EC2" and click Next c) Select the following recommended policies for IAM role for Memvisor. Policy Names: AmazonEC2FullAccess AmazonElasticMapReduceRole AmazonS3FullAccess AmazonElasticMapReduceforEC2Role AmazonElasticMapReduceforAutoScalingRole d) Enter Role name and other details and click Create role.
Data Platform for Fast Insights
©2017 Cancun Systems, Inc. www.CancunSystems.net
4
Installation Guide
Step 4: Set root volume size Modify the Root Volume Size to 32GB or more.
Step 5: Add tags This is an optional step. Add tags if needed.
Data Platform for Fast Insights
5
Installation Guide
Step 6: Select Security Group Select Security Group Either from existing group or create new
Data Platform for Fast Insights
6
Installation Guide
Step 7: Review and Click Launch
With the above step, a Cancun MemoryLake controller should get instantiated like any other AWS instance. Wait for the instance to be fully up and then in the AWS EC2 console click on the instance to
Data Platform for Fast Insights
7
Installation Guide
make note of it’s assigned external IP address. The following steps will happen in the web interface of MemoryLake.
Data Platform for Fast Insights
8
Installation Guide
Configure MemoryLake Using Controller UI Step 1: Enter license key Using the public IP address of the controller instance, open a browser window to get into Cancun controller UI (default port is 80). You should first see the login screen. The default username is admin and the default password is the controller’s AWS instance id. Please use the AWS console to get the instance id of the controller. Once you login, you will now be prompted to enter the license key that should have been provided by Cancun Systems to proceed to the next step. In case you have not received the license key, please contact [email protected] for a valid license key.
Step 2: Choose cluster type Once you are authenticated and entered a valid license key, you will now be prompted to select the cluster type. Since you are in an AWS environment, you will be asked to choose between EMR or EC2 . In the case of EC2 the assumption is that the Hadoop cluster has been manually setup.
Data Platform for Fast Insights
9
Installation Guide
Step 3: Configure Memnode and Memorylake Cache Select type of deployment as either Local Memnode or Local Cache with external Memnode and choose the volume type, volume size based on the use case and the required number of IOPS. Refer to admin guide for more details regarding these configurations
Data Platform for Fast Insights
10
Installation Guide
Step 4: Choose the underlay FS type In the case of EMR, please choose EMRFS as the underlay and specify the underlying S3 bucket.
Data Platform for Fast Insights
11
Installation Guide
Step 5: Commit configuration
EC2 Cluster Please note, if EC2 was selected in the first step, you will then be taken to the main configuration page as shown below. Here the individual nodes must be configured. For detailed documentation, please refer to the Installation Guide.
Data Platform for Fast Insights
12
Installation Guide
Conclusion For more details and other questions please contact [email protected].
Data Platform for Fast Insights
13
September, 2017
Installation Guide
Table of Contents INTRODUCTION
3
STEPS TO INSTANTIATE MEMORYLAKE
3
STEP 1: CHOOSE AMI
3
STEP 2: SET INSTANCE TYPE
4
STEP 3: SELECTING VPC GROUP AND SETTING IAM ROLE
4
STEP 4: SET ROOT VOLUME SIZE
5
STEP 5: ADD TAGS
5
STEP 6: SELECT SECURITY GROUP
6
STEP 7: REVIEW AND CLICK LAUNCH
7
CONFIGURE MEMORYLAKE USING CONTROLLER UI
9
STEP 1: ENTER LICENSE KEY
9
STEP 2: CHOOSE CLUSTER TYPE
9
STEP 3: CONFIGURE MEMNODE AND MEMORYLAKE CACHE
10
STEP 4: CHOOSE THE UNDERLAY FS TYPE
11
STEP 5: COMMIT CONFIGURATION
12
EC2 CLUSTER
12
CONCLUSION
13
Data Platform for Fast Insights
2
Installation Guide
Introduction This document details the steps to get Cancun’s MemoryLake instantiated on AWS using the AMI on AWS’s Market Place. For details on configuring and using MemoryLake, please refer to the detailed Installation guide.
Steps to Instantiate MemoryLake Step 1: Choose AMI Choose the Cancun AMI from the Marketplace as shown in the image below.
Please note, the Cancun Controller AMI does support 1-click. With 1-click the instance will get invoked with instance type t2.large.
Data Platform for Fast Insights
3
Installation Guide
Step 2: Set instance type When 1-click is not used you will then have to select the instance type and our recommendation is either a t2.large or an m3.large.
Step 3: Selecting VPC group and setting IAM role An IAM role must be attached with controller instance while launching the Memvisor AMI. Steps for creating an IAM role: a) Go to IAM Dashboard, click on 'Create new role' b) Select AWS Service Role as "Amazon EC2" and click Next c) Select the following recommended policies for IAM role for Memvisor. Policy Names: AmazonEC2FullAccess AmazonElasticMapReduceRole AmazonS3FullAccess AmazonElasticMapReduceforEC2Role AmazonElasticMapReduceforAutoScalingRole d) Enter Role name and other details and click Create role.
Data Platform for Fast Insights
©2017 Cancun Systems, Inc. www.CancunSystems.net
4
Installation Guide
Step 4: Set root volume size Modify the Root Volume Size to 32GB or more.
Step 5: Add tags This is an optional step. Add tags if needed.
Data Platform for Fast Insights
5
Installation Guide
Step 6: Select Security Group Select Security Group Either from existing group or create new
Data Platform for Fast Insights
6
Installation Guide
Step 7: Review and Click Launch
With the above step, a Cancun MemoryLake controller should get instantiated like any other AWS instance. Wait for the instance to be fully up and then in the AWS EC2 console click on the instance to
Data Platform for Fast Insights
7
Installation Guide
make note of it’s assigned external IP address. The following steps will happen in the web interface of MemoryLake.
Data Platform for Fast Insights
8
Installation Guide
Configure MemoryLake Using Controller UI Step 1: Enter license key Using the public IP address of the controller instance, open a browser window to get into Cancun controller UI (default port is 80). You should first see the login screen. The default username is admin and the default password is the controller’s AWS instance id. Please use the AWS console to get the instance id of the controller. Once you login, you will now be prompted to enter the license key that should have been provided by Cancun Systems to proceed to the next step. In case you have not received the license key, please contact [email protected] for a valid license key.
Step 2: Choose cluster type Once you are authenticated and entered a valid license key, you will now be prompted to select the cluster type. Since you are in an AWS environment, you will be asked to choose between EMR or EC2 . In the case of EC2 the assumption is that the Hadoop cluster has been manually setup.
Data Platform for Fast Insights
9
Installation Guide
Step 3: Configure Memnode and Memorylake Cache Select type of deployment as either Local Memnode or Local Cache with external Memnode and choose the volume type, volume size based on the use case and the required number of IOPS. Refer to admin guide for more details regarding these configurations
Data Platform for Fast Insights
10
Installation Guide
Step 4: Choose the underlay FS type In the case of EMR, please choose EMRFS as the underlay and specify the underlying S3 bucket.
Data Platform for Fast Insights
11
Installation Guide
Step 5: Commit configuration
EC2 Cluster Please note, if EC2 was selected in the first step, you will then be taken to the main configuration page as shown below. Here the individual nodes must be configured. For detailed documentation, please refer to the Installation Guide.
Data Platform for Fast Insights
12
Installation Guide
Conclusion For more details and other questions please contact [email protected].
Data Platform for Fast Insights
13
