Fast-Terraform (with AWS)

This repo covers Terraform with Hands-on LABs and Samples using AWS (comprehensive, but simple):

• Resources, Data Sources, Variables, Meta Arguments, Provisioners, Dynamic Blocks, Modules, Workspaces, Templates, Remote State.
• Provisioning AWS Components (EC2, EBS, EFS, IAM Roles, IAM Policies, Key-Pairs, VPC with Network Components, Lambda, ECR, ECS with Fargate, EKS with Managed Nodes, ASG, ELB, API Gateway, S3, CloudFront CodeCommit, CodePipeline, CodeBuild, CodeDeploy), use cases and details. Possible usage scenarios are aimed to update over time.

Why was this repo created?

• Shows Terraform details in short with simple, clean demos and Hands-on LABs
• Shows Terraform AWS Hands-on Samples, Use Cases

Keywords: Terraform, Infrastructure as Code, AWS, Cloud Provisioning

Quick Look (How-To): Terraform Hands-on LABs

These LABs focus on Terraform features, help to learn Terraform:

• LAB-00: Installing Terraform, AWS Configuration with Terraform
• LAB-01: Terraform Docker => Pull Docker Image, Create Docker Container on Local Machine
• LAB-02: Resources => Provision Basic EC2 (Ubuntu 22.04)
• LAB-03: Variables, Locals, Output => Provision EC2s
• LAB-04: Meta Arguments (Count, For_Each, Map) => Provision IAM Users, Groups, Policies, Attachment Policy-User
• LAB-05: Dynamic Blocks => Provision Security Groups, EC2, VPC
• LAB-06: Data Sources with Depends_on => Provision EC2
• LAB-07: Provisioners (file, remote-exec), Null Resources (local-exec) => Provision Key-Pair, SSH Connection
• LAB-08: Modules => Provision EC2
• LAB-09: Workspaces => Provision EC2 with Different tfvars Files
• LAB-10: Templates => Provision IAM User, User Access Key, Policy
• LAB-11: Backend - Remote States => Provision EC2 and Save State File on S3
• Terraform Cheatsheet

Quick Look (How-To): AWS Terraform Hands-on Samples

These samples focus on how to create and use AWS components (EC2, EBS, EFS, IAM Roles, IAM Policies, Key-Pairs, VPC with Network Components, Lambda, ECR, ECS with Fargate, EKS with Managed Nodes, ASG, ELB, API Gateway, S3, CloudFront, CodeCommit, CodePipeline, CodeBuild, CodeDeploy) with Terraform:

• SAMPLE-01: Provisioning EC2s (Windows 2019 Server, Ubuntu 20.04) on VPC (Subnet), Creating Key-Pair, Connecting Ubuntu using SSH, and Connecting Windows Using RDP
• SAMPLE-02: Provisioning Lambda Function, API Gateway and Reaching HTML Page in Python Code From Browser
• SAMPLE-03: EBS (Elastic Block Storage: HDD, SDD) and EFS (Elastic File System: NFS) Configuration with EC2s (Ubuntu and Windows Instances)
• SAMPLE-04: Provisioning ECR (Elastic Container Repository), Pushing Image to ECR, Provisioning ECS (Elastic Container Service), VPC (Virtual Private Cloud), ELB (Elastic Load Balancer), ECS Tasks and Service on Fargate Cluster
• SAMPLE-05: Provisioning ECR, Lambda Function and API Gateway to run Flask App Container on Lambda
• SAMPLE-06: Provisioning EKS (Elastic Kubernetes Service) with Managed Nodes using Blueprint and Modules
• SAMPLE-07: CI/CD on AWS => Provisioning CodeCommit and CodePipeline, Triggering CodeBuild and CodeDeploy, Running on Lambda Container
• SAMPLE-08: Provisioning S3 and CloudFront to serve Static Web Site
• SAMPLE-09: Running Gitlab Server using Docker on Local Machine and Making Connection to Provisioned Gitlab Runner on EC2 in Home Internet without Using VPN
• SAMPLE-10: Implementing MLOps Pipeline using GitHub, AWS CodePipeline, AWS CodeBuild, AWS CodeDeploy, and AWS Sagemaker (Endpoint)

Table of Contents

• Motivation
• What is Terraform?
• How Terraform Works?
• Terraform File Components
  • Providers
  • Resources
  • Variables (tfvar)
  • Values (Locals, Outputs)
  • Meta Arguments
  • Dynamic Blocks
  • Data Sources
  • Provisioners (file, remote_exec, local_exec), Null Resource
  • Modules
  • Workspaces
  • Templates
  • Backends and Remote States
• Terraform Best Practices
• AWS Terraform Hands-on Samples
  • SAMPLE-01: EC2s (Windows 2019 Server, Ubuntu 20.04), VPC, Key-Pairs for SSH, RDP connections
  • SAMPLE-02: Provisioning Lambda Function, API Gateway and Reaching HTML Page in Python Code From Browsers
  • SAMPLE-03: EBS (Elastic Block Storage: HDD, SDD) and EFS (Elastic File System: NFS) Configuration with EC2s (Ubuntu and Windows Instances)
  • SAMPLE-04: Provisioning ECR (Elastic Container Repository), Pushing Image to ECR, Provisioning ECS (Elastic Container Service), VPC (Virtual Private Cloud), ELB (Elastic Load Balancer), ECS Tasks and Service on Fargate Cluster
  • SAMPLE-05: Provisioning ECR, Lambda Function and API Gateway to run Flask App Container on Lambda
  • SAMPLE-06: Provisioning EKS (Elastic Kubernetes Service) with Managed Nodes using Blueprint and Modules
  • SAMPLE-07: CI/CD on AWS => Provisioning CodeCommit and CodePipeline, Triggering CodeBuild and CodeDeploy, Running on Lambda Container
  • SAMPLE-08: Provisioning S3 and CloudFront to serve Static Web Site
  • SAMPLE-09: Running Gitlab Server using Docker on Local Machine and Making Connection to Provisioned Gitlab Runner on EC2 in Home Internet without Using VPN
  • SAMPLE-10: Implementing MLOps Pipeline using GitHub, AWS CodePipeline, AWS CodeBuild, AWS CodeDeploy, and AWS Sagemaker (Endpoint)
• Details
• Terraform Cheatsheet
• Other Useful Resources Related Terraform
• References

Motivation

Why should we use / learn Terraform?

• Terraform is cloud-agnostic and popular tool to create/provision Cloud Infrastructure resources/objects (e.g. Virtual Private Cloud, Virtual Machines, Lambda, etc.)
  • Manage any infrastructure
  • Similar to Native Infrastructure as Code (IaC): CloudFormation (AWS), Resource Manager (Azure), Google Cloud Deployment Manager (Google Cloud)
• It is free, open source (https://github.com/hashicorp/terraform) and has a large community with enterprise support options.
• Commands, tasks, codes turn into the IaC.
  • With IaC, tasks is savable, versionable, repetable and testable.
  • With IaC, desired configuration is defined as 'Declerative Way'.
• Agentless: Terraform doesn’t require any software to be installed on the managed infrastructure
• It has well-designed documentation:
  • https://developer.hashicorp.com/terraform/language
  • https://registry.terraform.io/providers/hashicorp/aws/latest/docs
• Terraform uses a modular structure.
• Terraform tracks your infrastructure with TF state file. (ref: Redis)

What is Terraform?

• Terraform is cloud-independent provisioning tool to create Cloud infrastructure.
• Creating infrastructure code with HCL (Hashicorp Language) that is similar to YAML, JSON, Python.
• Terraform Basic Tutorial for AWS:
  • https://developer.hashicorp.com/terraform/tutorials/aws-get-started
• Reference and Details:
  • https://developer.hashicorp.com/terraform/intro (ref: Terraform)

How Terraform Works?

• Terraform works with different providers (AWS, Google CLoud, Azure, Docker, K8s, etc.)

• After creating Terraform Files (tf), terraform commands:

  • init: downloads the required executable apps dependent on providers.
  • validate: confirms the tf files.
  • plan: dry-run for the infrastructure, not actually running/provisioning the infrastructure
  • apply: runs/provisions the infrastructure
  • destroy: deletes the infrastructure

• Main Commands:

terraform init
terraform validate
terraform plan            # ask for confirmation (yes/no), after running command
terraform apply           # ask for confirmation (yes/no), after running command
terraform destroy         # ask for confirmation (yes/no), after running command

• Command Variants:

terraform plan --var-file="terraform-dev.tfvars"            # specific variable files
terraform apply -auto-approve                               # no ask for confirmation
terraform apply --var-file="terraform-prod.tfvars"          # specific variable files
terraform destroy --var-file="terraform-prod.tfvars"        # specific variable files

• Terraform Command Structure:

  

• Terraform Workflow:

  

• TF state file stores the latest status of the infrastructure after running "apply" command.

• TF state file deletes the status of the infrastructure after running "destroy" command.

• TF state files are stored:

  • on local PC
  • on remote cloud (AWS S3, Terraform Cloud)

• Please have a look LABs and SAMPLEs to learn how Terraform works in real scenarios.

Terraform File Components

• Terraform file has different components to define infrastructure for different purposes.
  • Providers,
  • Resources,
  • Variables,
  • Values (locals, outputs),
  • Meta Argurments (for, for_each, map, depends_on, life_cycle),
  • Dynamic Blocks,
  • Data Sources,
  • Provisioners,
  • Workspaces,
  • Modules,
  • Templates.

Providers

• Terraform supposes for different providers (AWS, Google Cloud, Azure).

• Terraform downloads required executable files from own cloud to run IaC (code) for the corresponding providers.

• AWS (https://registry.terraform.io/providers/hashicorp/aws/latest/docs):

  

• Google Cloud (GCP) (https://registry.terraform.io/providers/hashicorp/google/latest/docs):

  

• Azure (https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs):

  

• Docker (https://registry.terraform.io/providers/kreuzwerker/docker/latest/docs/resources/container):

  

Resources

• Resources are used to define for different cloud components and objects (e.g. EC2 instances, VPC, VPC Compoenents: Router Tables, Subnets, IGW, .., Lambda, API Gateway, S3 Buckets, etc.).

• To learn the details, features of the cloud components, you should know how the cloud works, which components cloud have, how to configure the cloud components.

• Syntax:

  • resource <AWS_Object> <User_Defined_Variable_Name_With_Underscore> {}

    • e.g. resource "aws_instance" "instance" {}
    • e.g. resource "aws_vpc" "my_vpc" {}
    • e.g. resource "aws_subnet" "public" {}
    • e.g. resource "aws_security_group" "allow_ssh" {}

    

• Important part is to check the usage of the resources (shows which arguments are optional, or required) from Terraform Registry page by searching the "Object" terms like "instance", "vpc", "security groups"

  • https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/instance

  

• There are different parts:

  • Argument References (inputs) (some parts are optional, or required)
  • Attributes References (outputs)
  • Example code snippet to show how it uses
  • Others (e.g. timeouts, imports)

• Go to LAB to learn resources:

  • LAB-02: Resources => Provision Basic EC2 (Ubuntu 22.04)

Variables (tfvar)

• Variables help to avoid hard coding on the infrastructure code.

• The Terraform language uses the following types for its values:

  • string: a sequence of Unicode characters representing some text, like "hello".
  • number: a numeric value. The number type can represent both whole numbers like 15 and fractional values like 6.283185.
  • bool: a boolean value, either true or false. bool values can be used in conditional logic.
  • list (or tuple): a sequence of values, like ["one", "two"]. Elements in a list or tuple are identified by consecutive whole numbers, starting with zero.
  • map (or object): a group of values identified by named labels, like {name = "Mabel", age = 52}.
  • Strings, numbers, and bools are sometimes called primitive types. Lists/tuples and maps/objects are sometimes called complex types, structural types, or collection types.

• Normally, if you define variables, after running "terraform apply" command, on the terminal, stdout requests from the user to enter variables.

• But, if the "tfvar" file is defined, variables in the "tfvar" file are entered automatically in the corresponding variable fields.

  

• Tfvar files for development ("DEV") environment:

  

• Tfvar files for production ("PROD") environment:

  

• Go to LAB to learn variables and tfvar file, and provisioning EC2 for different environments:

  • LAB-03: Variables, Locals, Output => Provision EC2s

Values (Locals, Outputs)

• "Locals" are also the variables that are mostly used as place-holder variables.

  

• "Outputs" are used to put the cloud objects' information (e.g. public IP, DNS, detailed info) out as stdout.

  

• "Outputs" after running "terraform apply" command on the terminal stdout:

  

• Go to LAB to learn more about variables, locals, outputs and provisioning EC2:

  • LAB-03: Variables, Locals, Output => Provision EC2s

Meta Arguments

• Different meta arguments are used for different purposes:

  • count: the number of objects (e.g. variables, resources, etc.)
    • https://developer.hashicorp.com/terraform/language/meta-arguments/count
  • for: iteration over the list of objects (e.g. variables, resources, etc.)
  • for_each: iteration over the set of objects (e.g. variables, resources, etc.)
    • https://developer.hashicorp.com/terraform/language/meta-arguments/for_each
  • depends_on: shows the priority order of creation of the resource. If "A" should be created before "B", user should write "depends_on= A" as an argument under "B".
    • https://developer.hashicorp.com/terraform/language/meta-arguments/depends_on
  • life_cycle: uses to make life cycle relationship between objects (e.g. variables, resources, etc.)
    • https://developer.hashicorp.com/terraform/language/meta-arguments/lifecycle
  • providers: specifies which provider configuration to use for a resource, overriding Terraform's default behavior.
    • https://developer.hashicorp.com/terraform/language/meta-arguments/resource-provider

• Count:

  

• For_each, For:

  

• Go to LAB to learn:

  • LAB-04: Meta Arguments (Count, For_Each, Map) => Provision IAM Users, Groups, Policies, Attachment Policy-User

Dynamic Blocks

• "Dynamic blocks" creates small code template that reduces the code repetition.

• In the example below, it isn't needed to create parameters (description, from_port, to_port, protocol, cidr_blocks) for each ingress ports:

  

• Go to LAB to learn:

  • LAB-05: Dynamic Blocks => Provision Security Groups, EC2, VPC

Data Sources

• "Data Sources" helps to retrieve/fetch/get data/information from previously created/existed cloud objects/resources.

• In the example below:

  • "filter" keyword is used to select/filter the existed objects (reources, instances, etc.)
  • "depends_on" keyword provides to run the data block after resource created.

  

• Go to LAB to learn:

  • LAB-06: Data Sources with Depends_on => Provision EC2

Provisioners

• "Provisioners" provides to run any commands on the remote instance/virtual machine, or on the local machine.

• "Provisioners" in the resource block runs only once while creating the resource on remote instance. If the resource is created/provisioned before, "provisioner" block in the resource block doesn't run again.

• With "null_resource":

  • Without creating any resource,
  • Without depending any resource,
  • Any commands can be run.

• Provisioners in the "null_resource" run multiple times and it doesn't depend on the resource.

• With provisioner "file", on the remote instance, new file can be created

• With provisioner "remote-exec", on the remote instance, any command can be run

• With provisioner "local-exec", on the local PC, any command can be run on any shell (bash, powershell)

  

• Go to LAB to learn about different provisioners:

  • LAB-07: Provisioners (file, remote-exec), Null Resources (local-exec) => Provision Key-Pair, SSH Connection

Modules

• "Modules" helps organize configuration, encapsulation, re-usability and consistency.

• "Modules" is the structure/container for multiple resources that are used together.

• Each modules usually have variables.tf that is configured from the parent tf file.

• Details: https://developer.hashicorp.com/terraform/language/modules

• AWS modules for different components (VPC, IAM, SG, EKS, S3, Lambda, RDS, etc.)

  • https://registry.terraform.io/browse/modules?provider=aws

    

• Go to LAB to learn:

  • LAB-08: Modules => Provision EC2

Workspaces

• With "Workspaces":

  • a parallel, distinct copy of your infrastructure which you can test and verify in the development, test, and staging,
  • like git, you are working on different workspaces (like branch),
  • single code but different workspaces,
  • it creates multiple state files on different workspace directories.

• Workspace commands:

terraform workspace help                       # help for workspace commands
terraform workspace new [WorkspaceName]        # create new workspace
terraform workspace select [WorkspaceName]     # change/select another workspace
terraform workspace show                       # show current workspace
terraform workspace list                       # list all workspaces
terraform workspace delete [WorkspaceName]     # delete existed workspace

• "dev" and "prod" workspaces are created:

  

• Go to LAB to learn:

  • LAB-09: Workspaces => Provision EC2 with Different tfvars Files

Templates

• With "Templates" (.tftpl files):

  • avoid to write same code snippets multiple times,
  • provide to shorten the code

• In the example below, templates fields are filled with list in the resource code block:

  

• Go to LAB to learn "Templates":

  • LAB-10: Templates => Provision IAM User, User Access Key, Policy

Backend and Remote States

• With enabling remote state file using backend:

  • multiple user can work on the same state file
  • saving common state file on S3 is possible

• With backend part ("s3"), state file is stored on S3:

  

• On AWS S3 Bucket, terraform.tfstate file is saved:

  

• Go to LAB to learn:

  • LAB-11: Backend - Remote States => Provision EC2 and Save State File on S3

Terraform Best Practices

• Don't change/edit anything on state file manually. Manipulate state file only through TF commands (e.g. terraform apply, terraform state).
• Use remote state file to share the file with other users. Keep state file on the Cloud (S3, Terraform Cloud, etc.)
• To prevent concurrent changes, state locking is important. Hence concurrent change from multiple user can be avoided.
  • S3 supports state locking and consistency via DynamoDB.
• Backing up state file is also important to save the status. S3 enables versioning. Versioning state file can provide you backing up the state file.
• If you use multiple environment (dev, test, staging, production), use 1 state file per environment. Terraform workspace provide multiple state files for different environments.
• Use Git repositories (Github, Gitlab) to host TF codes to share other users.
• Behave your Infrastructure code as like your application code. Create CI pipeline/process for your TF Code (review tf code, run automated tests). This will shift your infrastructure code high quality.
• Execute Terraform only in an automated build, CD pipeline/process. This helps to run code automatically and run from one/single place.
• For naming conventions: https://www.terraform-best-practices.com/naming

AWS Terraform Hands-on Samples

SAMPLE-01: EC2s (Windows 2019 Server, Ubuntu 20.04), VPC, Key-Pairs for SSH, RDP connections

• This sample shows:

  • how to create Key-pairs (public and private keys) on AWS,
  • how to create EC2s (Ubuntu 20.04, Windows 2019 Server),
  • how to create Virtual Private Cloud (VPC), VPC Components (Public Subnet, Internet Gateway, Route Table) and link to each others,
  • how to create Security Groups (for SSH and Remote Desktop).

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/ec2-vpc-ubuntu-win-ssh-rdp

• Go to the Hands-On Sample:

  • SAMPLE-01: Provisioning EC2s (Windows 2019 Server, Ubuntu 20.04) on VPC (Subnet), Creating Key-Pair, Connecting Ubuntu using SSH, and Connecting Windows Using RDP

  

SAMPLE-02: Provisioning Lambda Function, API Gateway and Reaching HTML Page in Python Code From Browsers

• This sample shows:

  • how to create Lambda function with Python code,
  • how to create lambda role, policy, policy-role attachment, lambda api gateway permission, zipping code,
  • how to create api-gateway resource and method definition, lambda - api gateway connection, deploying api gateway, api-gateway deployment URL as output
  • details on AWS Lambda, API-Gateway, IAM.

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/lambda-role-policy-apigateway-python

• Go to the Hands-On Sample:

  • SAMPLE-02: Provisioning Lambda Function, API Gateway and Reaching HTML Page in Python Code From Browser

  

SAMPLE-03: EBS (Elastic Block Storage: HDD, SDD) and EFS (Elastic File System: NFS) Configuration with EC2s (Ubuntu and Windows Instances)

• This sample shows:

  • how to create EBS, mount on Ubuntu and Windows Instances,
  • how to create EFS, mount on Ubuntu Instance,
  • how to provision VPC, subnet, IGW, route table, security group.

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/ec2-ebs-efs

• Go to the Hands-On Sample:

  • SAMPLE-03: EBS (Elastic Block Storage: HDD, SDD) and EFS (Elastic File System: NFS) Configuration with EC2s (Ubuntu and Windows Instances)

  

SAMPLE-04: Provisioning ECR (Elastic Container Repository), Pushing Image to ECR, Provisioning ECS (Elastic Container Service), VPC (Virtual Private Cloud), ELB (Elastic Load Balancer), ECS Tasks and Service on Fargate Cluster

• This sample shows:

  • how to create Flask-app Docker image,
  • how to provision ECR and push to image to this ECR,
  • how to provision VPC, Internet Gateway, Route Table, 3 Public Subnets,
  • how to provision ALB (Application Load Balancer), Listener, Target Group,
  • how to provision ECS Fargate Cluster, Task and Service (running container as Service).

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/ecr-ecs-elb-vpc-ecsservice-container

• Go to the Hands-On Sample:

  • SAMPLE-04: Provisioning ECR (Elastic Container Repository), Pushing Image to ECR, Provisioning ECS (Elastic Container Service), VPC (Virtual Private Cloud), ELB (Elastic Load Balancer), ECS Tasks and Service on Fargate Cluster

  

SAMPLE-05: Provisioning ECR, Lambda Function and API Gateway to run Flask App Container on Lambda

• This sample shows:

  • how to create Flask-app-serverless image to run on Lambda,
  • how to create ECR and to push image to ECR,
  • how to create Lambda function, Lambda role, policy, policy-role attachment, Lambda API Gateway permission,
  • how to create API Gateway resource and method definition, Lambda - API Gateway connection, deploying API Gateway.

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/lambda-container-apigateway-flaskapp

• Go to the Hands-On Sample:

  • SAMPLE-05: Provisioning ECR, Lambda Function and API Gateway to run Flask App Container on Lambda

  

  

SAMPLE-06: Provisioning EKS (Elastic Kubernetes Service) with Managed Nodes using Blueprint and Modules

• This sample shows:

  • how to create EKS cluster with managed nodes using BluePrints and Modules.
  • EKS Blueprint is used to provision EKS cluster with managed nodes easily.
  • EKS Blueprint is used from:
    • https://github.com/aws-ia/terraform-aws-eks-blueprints

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/eks-managed-node-blueprint

• Go to the Hands-On Sample:

  • SAMPLE-06: Provisioning EKS (Elastic Kubernetes Service) with Managed Nodes using Blueprint and Modules

  

  

SAMPLE-07: CI/CD on AWS => Provisioning CodeCommit and CodePipeline, Triggering CodeBuild and CodeDeploy, Running on Lambda Container

• This sample shows:

  • how to create code repository using CodeCommit,
  • how to create pipeline with CodePipeline, create S3 bucket to store Artifacts for codepipeline stages' connection (source, build, deploy),
  • how to create builder with CodeBuild ('buildspec_build.yaml'), build the source code, create a Docker image,
  • how to create ECR (Elastic Container Repository) and push the build image into the ECR,
  • how to create Lambda Function (by CodeBuild automatically) and run/deploy container on Lambda ('buildspec_deploy.yaml').

• Source code is pulled from:

  • https://github.com/aws-samples/codepipeline-for-lambda-using-terraform

• Some of the fields are updated.

• It works with 'hashicorp/aws ~> 4.15.1', 'terraform >= 0.15'

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/codecommit-codepipeline-codebuild-codedeploy-lambda-container

• Go to the Hands-On Sample:

  • SAMPLE-07: CI/CD on AWS => Provisioning CodeCommit and CodePipeline, Triggering CodeBuild and CodeDeploy, Running on Lambda Container

  

SAMPLE-08: Provisioning S3 and CloudFront to serve Static Web Site

• This sample shows:

  • how to create S3 Bucket,
  • how to to copy the website to S3 Bucket,
  • how to configure S3 bucket policy,
  • how to create CloudFront distribution to refer S3 Static Web Site,
  • how to configure CloudFront (default_cache_behavior, ordered_cache_behavior, ttl, price_class, restrictions, viewer_certificate).

• Code: https://github.com/omerbsezer/Fast-Terraform/blob/main/samples/s3-cloudfront-static-website/

• Go to the Hands-On Sample:

  • SAMPLE-08: Provisioning S3 and CloudFront to serve Static Web Site

  

SAMPLE-09: Running Gitlab Server using Docker on Local Machine and Making Connection to Provisioned Gitlab Runner on EC2 in Home Internet without Using VPN

• This sample shows:
  • how to run Gitlab Server using Docker on WSL2 on-premise,
  • how to redirect external traffic to docker container port (Gitlab server),
  • how to configure on-premise PC network configuration,
  • how to run EC2 and install docker, gitlab-runner on EC2,
  • how to register Gitlab runner on EC2 to Gitlab Server on-premise (in Home),
  • how to run job on EC2 and returns artifacts to Gitlab Server on-premise (in Home).
• Code: https://github.com/omerbsezer/Fast-Terraform/blob/main/samples/gitlabserver-on-premise-runner-on-EC2/
• Go to the Hands-On Sample:
  • SAMPLE-09: Running Gitlab Server using Docker on Local Machine and Making Connection to Provisioned Gitlab Runner on EC2 in Home Internet without Using VPN

SAMPLE-10: Implementing MLOps Pipeline using GitHub, AWS CodePipeline, AWS CodeBuild, AWS CodeDeploy, and AWS Sagemaker (Endpoint)

• This sample shows:

  • how to create MLOps Pipeline
  • how to use GitHub Hooks (Getting Source Code from Github to CodePipeline)
  • how to create Build CodePipeline (Source, Build), CodeBuild (modelbuild_buildspec.yml), Deploy CodePipeline (Source, Build, DeployStaging, DeployProd), CodeBuild (modeldeploy_buildspec.yml)
  • how to save the model and artifacts on S3
  • how to create and test models using Notebooks

• Code: https://github.com/omerbsezer/Fast-Terraform/tree/main/samples/mlops-sagemaker-github-codepipeline-codebuild-codedeploy

• Go to the Hands-On Sample:

  • SAMPLE-10: Implementing MLOps Pipeline using GitHub, AWS CodePipeline, AWS CodeBuild, AWS CodeDeploy, and AWS Sagemaker (Endpoint)

  

Details

• To validate the Terraform files:
  • "terraform validate"
• For dry-run:
  • "terraform plan"
• For formatting:
  • "terraform fmt"
• For debugging:
  • Bash: export TF_LOG="DEBUG"
  • PowerShell: $env:TF_LOG="DEBUG"
• For debug logging:
  • Bash: export TF_LOG_PATH="tmp/terraform.log"
  • PowerShell: $env:TF_LOG_PATH="C:\tmp\terraform.log"

Terraform Cheatsheet

• Terraform Cheatsheet

Other Useful Resources Related Terraform

• AWS Samples (Advanced):
  • https://github.com/aws-samples
• AWS Samples with Terraform (Advanced):
  • https://github.com/orgs/aws-samples/repositories?q=Terraform&type=all&language=&sort=
• AWS Integration and Automation (Advanced):
  • https://github.com/aws-ia
• Reference Guide: Terraform Registry Documents
  • https://registry.terraform.io/providers/hashicorp/aws/latest/docs

References

• Redis: https://developer.redis.com/create/aws/terraform/
• https://developer.hashicorp.com/terraform/intro
• https://github.com/aws-samples
• https://github.com/orgs/aws-samples/repositories?q=Terraform&type=all&language=&sort=
• https://github.com/aws-ia/terraform-aws-eks-blueprints
• https://github.com/aws-ia