{"id":4392,"date":"2020-10-27T16:10:37","date_gmt":"2020-10-27T10:40:37","guid":{"rendered":"https:\/\/opstree.com\/blog\/\/?p=4392"},"modified":"2025-11-20T18:38:25","modified_gmt":"2025-11-20T13:08:25","slug":"how-to-implement-ci-cd-using-aws-codebuild-codedeploy-and-codepipeline","status":"publish","type":"post","link":"https:\/\/opstree.com\/blog\/2020\/10\/27\/how-to-implement-ci-cd-using-aws-codebuild-codedeploy-and-codepipeline\/","title":{"rendered":"How to implement CI\/CD using AWS CodeBuild, CodeDeploy and CodePipeline"},"content":{"rendered":"\r\n

As we know that CI\/CD<\/strong> (Continuous Integration\/Continuous Deployment<\/strong>) is inevitable process in our DevOps<\/strong> culture , we should always look for a better .. more efficient solution to implement the same.<\/p>\r\n\r\n\r\n\r\n

CI\/CD<\/strong> gives us the capability to continuously integrate code changes, test it , deploy it and having continuous feedback<\/strong> which helps us to accelerate our development speed , off-course it reduces time in testing perspective and it helps you to make your releases streamline<\/strong>.<\/p>\r\n\r\n\r\n\r\n

So you dont have to worry about anything except CODING<\/strong> as CI\/CD<\/strong> will take care of everything for you. \ud83d\ude42<\/p>\r\n\r\n\r\n\r\n

\r\n
https:\/\/media.giphy.com\/media\/B1uajA01vvL91Urtsp\/source.gif<\/div>\r\n<\/figure>\r\n\r\n\r\n\r\n

<\/p>\r\n\r\n\r\n\r\n

There are lot of tools in market which helps you to implement CI\/CD . ..Well I was using “Jenkins<\/strong>” as a CI\/CD<\/strong> tool which I guess is the best open-source tool that I have ever known \ud83d\ude42 .<\/p>\r\n\r\n\r\n\r\n

But Today, we will talk about some other good alternatives : AWS CodeBuild , CodeDeploy and CodePipeline <\/strong>and its benefits over other available tools in market.<\/p>\r\n\r\n\r\n\r\n

In this blog, I will explain about the process to implement CI\/CD step by step via above mentioned AWS services.<\/p>\r\n\r\n\r\n\r\n

Here, we will deploy a sample Java application<\/strong> spring3hibernate<\/a> in Ec2 servers which is behind an Application load Balancer<\/strong> using rolling deployment strategy.<\/strong><\/p>\r\n\r\n\r\n\r\n

STEP -1 Create a CodeBuild Project<\/em><\/strong><\/p>\r\n\r\n\r\n\r\n

We will use CodeBuild project<\/strong> to test and build the above sample Java app and prepares the artifact<\/strong> (WAR<\/strong> file) which we will use it later for deployment.<\/p>\r\n\r\n\r\n\r\n

Search CodeBuild service in AWS console navigation panel and then click on Create Build project<\/strong>.<\/p>\r\n\r\n\r\n\r\n

As you can see below, we need to fill out CodeBuild Project Configuration. <\/strong>Mention Project<\/strong> Name<\/strong> , Description<\/strong> with some Tags<\/strong> as per your choice.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Then next part is Source<\/strong>. This section will describe the source provider from where CodeBuild<\/strong> will fetch your source code.<\/p>\r\n\r\n\r\n\r\n

It can be CODECOMMIT<\/strong> | CODEPIPELINE<\/strong> | GITHUB<\/strong> | S3<\/strong> | BITBUCKET<\/strong> | GITHUB_ENTERPRISE<\/strong> | NO_SOURCE<\/strong><\/p>\r\n\r\n\r\n\r\n

In our case it’s S3<\/strong>. We will store our source code as a zip in s3 bucket spring3-hibernate-app-bucket. Mention s3 object key as well and that will be the name of source code file that you have uploaded in s3 bucket.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Next step is to define Environment<\/strong> on which CodeBuild<\/strong> project will run. You can use AWS Managed<\/a> Image<\/strong> or your Custom Image<\/strong> from ECR<\/strong>. For simplicity I am using AWS managed image here as Amazon Linux 2 OS.<\/p>\r\n\r\n\r\n\r\n

Then you need to select Service Role<\/strong>. AWS<\/strong> by default provides you a new service role which will give your CodeBuild<\/strong> project access to S3<\/strong> , CloudWatch<\/strong> logs etc as per your configuration.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Select the compute size of CodeBuild<\/strong> project as per the requirement. In our case 3 GB memory<\/strong> would be enough.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

 <\/p>\r\n\r\n\r\n\r\n

Now the main part comes which is BuildSpec<\/strong>. Here you need to specifiy what commands you want to run to build your application. So there are two options to do the same :<\/p>\r\n\r\n\r\n\r\n

Use a Buildspec file<\/strong> : You need to include this file (by default buildspec.yml <\/strong>filename) in root directory of your source code. (This is what we will do in next step).<\/p>\r\n\r\n\r\n\r\n

OR<\/strong><\/p>\r\n\r\n\r\n\r\n

Insert Build commands<\/strong>: You can simply enter commands in the console that you want to run.<\/p>\r\n\r\n\r\n\r\n

You can use below content to prepare your buildspec.yml file and place it in root directory of your source code.<\/p>\r\n\r\n\r\n\r\n

The first phase “Build”<\/strong> will run mvn test <\/strong>and if it passes, then the second phase “Post_Build” <\/strong>will get triggered and it will execute mvn package command which will generate a WAR<\/strong> file. And then we specify Artifacts<\/strong> name that will get stored in S3 bucket. Change the name of the WAR<\/strong> file according to you. I have mentioned appspec.yml<\/strong> file as an artifact which I will explain later about its significance.<\/p>\r\n\r\n\r\n\r\n

version: 0.2\r\nphases:\r\n  build:\r\n    commands:\r\n      - echo Build started on `date` \r\n      - mvn test \r\n  post_build: \r\n    commands: \r\n      - echo Build completed on `date` \r\n      - mvn package\r\nartifacts: \r\n  files:\r\n    - appspec.yml\r\n    - target\/Spring3HibernateApp.war\r\n  discard-paths: yes<\/span><\/pre>\r\n\r\n\r\n\r\n
Select Use a Buildspec file<\/strong> option and move on to Artifacts<\/strong> section where we will specify where we need to store project’s final artifacts<\/strong>. I am storing in same Source S3 <\/strong>bucket (spring3-hibernate-app-bucket)<\/strong> and selected Zip option to compress the artifacts.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
And here comes the last part of Creating a CodeBuild project “LOGS”<\/strong>. This is an optional parameter. If you want to see logs of CodeBuild project execution , you need to select atleast one of the option (Cloudwatch \/ S3) <\/strong>.<\/p>\r\n\r\n\r\n\r\n
\"\"<\/figure>\r\n\r\n\r\n\r\n
Congratulations \ud83d\ude42 you just created your CodeBuild<\/strong> project. So Now lets jump onto CodeDeploy<\/strong> part but before that we need to do one thing:<\/p>\r\n\r\n\r\n\r\n
Place this appspec.yml<\/strong> file in the root directory of your source code. Here we are just specifying where our source code will be deployed in server (I mean in which location inside target server. ) In our case we are using tomcat<\/strong> for serving our application. So we are placing zip source code in \/var\/lib\/tomcat7\/webapps\/ <\/strong>oath.<\/p>\r\n\r\n\r\n\r\n
version: 0.0\r\nos: linux\r\n\r\nfiles: \r\n  - source: \/ destination: \/var\/lib\/tomcat7\/webapps\/\r\n\r\npermissions: \r\n  - object: \/ \r\n    pattern: \"**\" \r\n    owner: tomcat \r\n    group: tomcat\r\n\r\n<\/span><\/pre>\r\n\r\n\r\n\r\n
For more info on Codebuild<\/strong> project , refer AWS docs https:\/\/docs.aws.amazon.com\/codebuild\/latest\/userguide\/welcome.html<\/a><\/p>\r\n\r\n\r\n\r\n
STEP -2 Create CodeDeploy App<\/em><\/strong><\/p>\r\n\r\n\r\n\r\n
We will use Codedeploy<\/strong> service to fetch latest build<\/strong> artifact<\/strong> and deploy it to the target instances one by one. But to make it work , you need to install codedeploy<\/strong>–agent<\/strong> <\/a>in your Ec2 machines .<\/p>\r\n\r\n\r\n\r\n
So Navigate to CodeDeploy service and click on Create Application<\/strong>. Mention CodeDeploy<\/strong> app name and select Ec2\/On-premises<\/strong> as a Compute platform as we will be deploying app in Ec2. And then click on Create Application<\/strong><\/p>\r\n\r\n\r\n\r\n
\"\"<\/figure>\r\n\r\n\r\n\r\n
Now we need to create a deployment group <\/strong>which will define on which instances it will deploy artifatcs<\/strong>.<\/p>\r\n\r\n\r\n\r\n
Click on Create Deployment Group<\/strong><\/p>\r\n\r\n\r\n\r\n
\"\"<\/figure>\r\n\r\n\r\n\r\n

Mention deployment group<\/strong> name. After that provide Service role Arn<\/strong>. You can create a service role in IAM with AWSCodeDeployRole<\/a> IAM policy attach and add codedeploy service<\/strong> as a Trust entity.<\/p>\r\n\r\n\r\n\r\n
And then you need to specify the type of deployment you need to do .. either IN-PLACE<\/strong> or BLUE\/GREEN<\/strong>. In this blog we will be using In-place deployment.<\/strong><\/p>\r\n\r\n\r\n\r\n
\"\"<\/figure>\r\n\r\n\r\n\r\n
Now Select Amazon<\/a> Ec2 instance<\/strong> in Environment Configuration<\/strong> and then we need provide tags . On the basis of tags provided CodeDeploy<\/strong> will fetch target instances. In my case I gave tag app:spring3hibernate<\/strong> and env:prod<\/strong> . So whichever Ec2<\/strong> servers having such tags on them , CodeDeploy<\/strong> will deploy artifacts<\/strong> in them.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
Now if you have already installed code-deploy agent<\/strong> in your Ec2<\/strong> servers, select Never option .. otherwise select other option so that System manager <\/strong>automatically install this agent in your target servers.<\/p>\r\n\r\n\r\n\r\n
In Deployment settings section, select CodeDeployDefaultOneAtATime<\/strong> which is CodeDeploy inbuilt deployment configuration . You can create custom one too.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
So in last part of CodeDeploy<\/strong> , we need tell CodeDeploy<\/strong> about the Load Balancer <\/strong>and the target group under which the target instances are attached, so that at the time of deployment Load balancer<\/strong> will block all traffic from each target server.<\/p>\r\n\r\n\r\n\r\n
NOTE: <\/strong>Uncheck Enable Load Balancing<\/strong> in case you dont have target servers under load balancer<\/strong>.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
For more info on CodeDeploy<\/strong>, refer AWS docs https:\/\/docs.aws.amazon.com\/codedeploy\/latest\/userguide\/welcome.html<\/a><\/p>\r\n\r\n\r\n\r\n
STEP-3 Create CodePipeline <\/em><\/p>\r\n\r\n\r\n\r\n
So Far we have created a CodeBuild<\/strong> project (which will test and build the artifact from java app) and a CodeDeploy<\/strong> application which will deploy the build artifact generated by CodeBuild<\/strong> project. But we need some tool which will integrate both services together and Thats where CodePipeline will help us \ud83d\ude42<\/p>\r\n\r\n\r\n\r\n
Click on Create Pipeline <\/strong>under CodePipeline<\/strong> service<\/p>\r\n\r\n\r\n\r\n
\"\"<\/figure>\r\n\r\n\r\n\r\n
 <\/p>\r\n\r\n\r\n\r\n
Enter Pipeline name<\/strong> and select New Service Role<\/strong>. In Advanced settings, select custom s3 Location for artifact<\/strong> store.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
 <\/p>\r\n\r\n\r\n\r\n
Now we need to add Source stage<\/strong> which will act like a trigger for Codepipeline<\/strong> execution . So whenever there will be some changes in source, CodePipeline<\/strong> will start execution .<\/p>\r\n\r\n\r\n\r\n
Select Source provider<\/strong> as S3<\/strong> and specify bucket name where your source code will be stored.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
 <\/p>\r\n\r\n\r\n\r\n
And now for Build<\/strong> stage<\/strong> , we will use the same CodeBuild<\/strong> project “build-spring3hibernate-app”<\/strong> that we have created above.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
And the last part would be the deploy stage and will specify CodeDeploy project “deploy-spring3hibernate-app”<\/strong> which we have configured earlier.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
Review and click on Create Pipeline <\/strong><\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
For more info on CodePipeline<\/strong>, refer AWS docs https:\/\/docs.aws.amazon.com\/codepipeline\/latest\/userguide\/welcome.html<\/a><\/p>\r\n\r\n\r\n\r\n
Step-4 Trigger CodePipeline <\/em><\/strong><\/p>\r\n\r\n\r\n\r\n
Now we just need to trigger our CodePipeline by uploading our source code zip file in s3 bucket.<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
You have done enough now . It’s time to SIT AND RELAX<\/strong> . ….. \ud83d\ude42<\/p>\r\n\r\n\r\n\t
\n\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t