Problem this Integration solves:<\/h3>\r\n\r\n\r\n\r\n\r\n- Eliminates the need of keeping a scheduler in the system. Lambda will work as a Scheduler.<\/li>\r\n\r\n\r\n\r\n
- No manual intervention will be required in case the file from one service is delayed by a minute or an hour due to any reason.\u00a0<\/li>\r\n\r\n\r\n\r\n
- Data exchange and processing between teams become more efficient and less error-prone.<\/li>\r\n\r\n\r\n\r\n
- Eliminates the need of checking the presence of files on S3. It all gets automated.<\/li>\r\n<\/ul>\r\n
<\/p>\r\n\r\n\r\n\r\n
Workflow:<\/strong><\/h3>\r\n\r\n\r\n\r\n\r\n- The object is uploaded to S3<\/li>\r\n\r\n\r\n\r\n
- S3 event triggers a Lambda function<\/li>\r\n\r\n\r\n\r\n
- Lambda starts Jenkins job using Jenkins API<\/li>\r\n<\/ol>\r\n\r\n\r\n\r\n
![\"\"](\"https:\/\/opstree.com\/blog\/\/wp-content\/uploads\/2022\/12\/image-1.png?w=599\")
<\/figure>\r\n\r\n\r\n\r\n<\/p>\r\n\r\n\r\n\r\n
Steps:<\/h2>\r\n\r\n\r\n\r\n1. Generate API Token Token:<\/h4>\r\n\r\n\r\n\r\n
We need to generate an API token for the user which we will use to authenticate the API call to trigger the job<\/p>\r\n\r\n\r\n\r\n
a).<\/strong> Go to People >> User-Name >> Configure >> Add New Token under API Token >> Generate >> Save<\/strong><\/p>\r\n\r\n\r\n\r\n![\"\"](\"https:\/\/lh6.googleusercontent.com\/16cVyszvkUo3kd-FHbnBijm8LZl3T1v40yd11SHP7sXqH1etcGuR_rbgo71arfj_LWBYWPxHKPvi3UUf6gpx-8IABpQI_6ULe7JcTM1apK7DKt6jJVib8ESgfwBfC_7RILo3slMwDL67wD1TnnLmn55ply3LQvIx9bYKMN87_0s_V266A_kSUbgmCzrZhQ\")
<\/figure>\r\n\r\n\r\n\r\nNow we need to add the authentication token to the job we want to trigger remotely.<\/p>\r\n\r\n\r\n\r\n
Note<\/strong>: API token is equal to the Authentication token<\/p>\r\n\r\n\r\n\r\nb). <\/strong>Go to job >> Configure >> Trigger builds remotely under Build Triggers >> add API Token to Authentication Token Field >> Save<\/strong><\/p>\r\n\r\n\r\n\r\n![\"\"](\"https:\/\/lh3.googleusercontent.com\/8zvHJ7WU1L-Prg1-PoSgLRUxnikHWwPffEOwLxhBnML93CBVnyZ5tn3ljlGE8DKGMYilQ2VzlLXoR0BjBXhZEh288Zg68Lo3VLw2Ujzhp-oSrb1oETEpfsjg9_0_98BiqwnwRI7bdAoeXI4-glxhyhyLrH1_H1NS2euHAoZIWowtraCllXq1i2ZXmpNF4w\")
<\/figure>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n
With this information, you can now create a URL that looks like this:<\/p>\r\n\r\n\r\n\r\n
http:\/\/user-name<\/strong>:<api_token>@jenkins-web-url.com\/job\/<JobName>\/build?token=<authentication_token><\/strong><\/p>\r\n\r\n\r\n\r\n\r\n- <JobName><\/strong> should be replaced with the Jenkins project name<\/strong>.<\/li>\r\n\r\n\r\n\r\n
- <api_token><\/strong> should be replaced with API Token<\/strong> we created for the user.<\/li>\r\n\r\n\r\n\r\n
- <authentication_token><\/strong> should be replaced with the API Token<\/strong>. If we want to trigger a parameterized job, replace the build with Buildwithparameters in the URL.<\/li>\r\n<\/ul>\r\n\r\n\r\n\r\n
2. Create S3 Bucket:<\/h4>\r\n\r\n\r\n\r\n
I have created an empty bucket named s3-test-Jenkins<\/strong>. This bucket will trigger the Lambda script if any file or folder is uploaded in this bucket.<\/p>\r\n\r\n\r\n\r\n3. Create Lambda Function:<\/h4>\r\n\r\n\r\n\r\n
I have created a lambda function<\/a> using the below steps:<\/p>\r\n\r\n\r\n\r\na).<\/strong> Go to Lambda >> create Function >> select Author From Scratch >>give function name >> select Python3.7 Runtime >> Create Function<\/strong><\/p>\r\n\r\n\r\n\r\n![\"\"](\"https:\/\/lh4.googleusercontent.com\/ihKwFmiMwCqeNkHyaCt5fVU-dOsqxRnU0R8VmzTUv8U1E5mzjBvUaa0HMf5NbszV1FGGBXdosZDnQKpi6LWXFiLWcUHvbKXfdS1RU_Ns-bT_-pR1LUwQlqD7haKfAFbNV5kb_m6f6ahLK2USwsjDHhgtgnK_KqjQhrKFvNt_fXs6PLvBj062YLhe09bvAQ\")
<\/figure>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n
Add the below code to the lambda function that was created in the above steps:<\/p>\r\n\r\n\r\n\r\n\r\n\r\n
import requests\r\nimport os\r\n \r\nUSERNAME = os.environ['USERNAME']\r\nJENKINS_URL = os.environ['JENKINS_URL']\r\nAPI_TOKEN = os.environ['API_TOKEN']\r\nAUTH_TOKEN = os.environ['AUTH_TOKEN']\r\n \r\n \r\ndef lambda_handler(event, context):\r\n try:\r\n url = \"http:\/\/{}:{}@{}\/build?token={}\".format(USERNAME, API_TOKEN, JENKINS_URL, AUTH_TOKEN)\r\n print(url)\r\n response = requests.post(url)\r\n if response.status_code != 201:\r\n print(response.status_code)\r\n except Exception as err:\r\n print(err.args[0])\r\n<\/code><\/pre>\r\n\r\n\r\n\r\n\r\n\r\nThese are the environment variables that you need to add the lambda function:<\/p>\r\n\r\n\r\n\r\n
b).<\/strong> Go to configuration<\/strong> >> Environment variables<\/strong> >> Add Environment Variable >>\u00a0Save<\/strong><\/p>\r\n\r\n\r\n\r\n![\"\"](\"https:\/\/lh3.googleusercontent.com\/hSHZpicSUgMHi44MXQPvLyKwKWzIasvtllM5SSYXrwHCykml0KEuRqf1f79jxmBpJ3tICNCh4xvVAiJnJJSFEFo3zrlBOqfs1lNQvQUcC-AMJbTcJ8atsCwYJYpR3VE2kyPaWnc-qDCrSzGE5Sulpk3tQ3eV1Ygsm1xvfMFi8ocJ4O1Zbc8B6_qNNzojoQ\")
<\/figure>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n
Add trigger into lambda function:<\/p>\r\n\r\n\r\n\r\n
c). Function >> select Add trigger >>Trigger configuration >> select s3 >> Bucket Name >> Event type >>Add<\/strong><\/p>\r\n\r\n\r\n\r\n![\"\"](\"https:\/\/lh3.googleusercontent.com\/0DsVNh8VYopqatLC1BfvKx0FS767MMS9wlMTW9r_zGN01W5wkvVNzspPddHDqZsatuEDpKsnWsCJXVGUFksjGTvHw6vzgvDrupDCRxnOqqqFL8QDb6BSuV-ZD63xwmhUckospcIQvujcibGY6HataH9V0cONtiOPHtkc0l_nx8ta326VL7ccVM_B0b4nnw\")
<\/figure>\r\n\r\n\r\n\r\n\r\n\r\n <\/p>\r\n
In this blog, we have seen how in a few easy steps we can trigger AWS Lambda through an S3 event and trigger Jenkins through AWS Lambda. I hope this blog will help you if any such scenario comes up. Happy learning!<\/p>\r\n\r\n\r\n\r\n\r\n\r\n
Blog Pundits: Deepak Gupta<\/a><\/strong> and Sandeep Rawat<\/a><\/strong><\/p>\r\n\r\n\r\n\r\nRelated Searches – AWS Consulting Partner<\/a> | Cloud Engineering Services<\/a><\/strong><\/p>\r\n\r\n\r\n\r\n
<\/p>\r\n\r\n\r\n\r\n
Workflow:<\/strong><\/h3>\r\n\r\n\r\n\r\n\r\n- The object is uploaded to S3<\/li>\r\n\r\n\r\n\r\n
- S3 event triggers a Lambda function<\/li>\r\n\r\n\r\n\r\n
- Lambda starts Jenkins job using Jenkins API<\/li>\r\n<\/ol>\r\n\r\n\r\n\r\n
<\/figure>\r\n\r\n\r\n\r\n<\/p>\r\n\r\n\r\n\r\n
Steps:<\/h2>\r\n\r\n\r\n\r\n1. Generate API Token Token:<\/h4>\r\n\r\n\r\n\r\n
We need to generate an API token for the user which we will use to authenticate the API call to trigger the job<\/p>\r\n\r\n\r\n\r\n
a).<\/strong> Go to People >> User-Name >> Configure >> Add New Token under API Token >> Generate >> Save<\/strong><\/p>\r\n\r\n\r\n\r\n<\/figure>\r\n\r\n\r\n\r\nNow we need to add the authentication token to the job we want to trigger remotely.<\/p>\r\n\r\n\r\n\r\n
Note<\/strong>: API token is equal to the Authentication token<\/p>\r\n\r\n\r\n\r\nb). <\/strong>Go to job >> Configure >> Trigger builds remotely under Build Triggers >> add API Token to Authentication Token Field >> Save<\/strong><\/p>\r\n\r\n\r\n\r\n<\/figure>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n
With this information, you can now create a URL that looks like this:<\/p>\r\n\r\n\r\n\r\n
http:\/\/user-name<\/strong>:<api_token>@jenkins-web-url.com\/job\/<JobName>\/build?token=<authentication_token><\/strong><\/p>\r\n\r\n\r\n\r\n\r\n- <JobName><\/strong> should be replaced with the Jenkins project name<\/strong>.<\/li>\r\n\r\n\r\n\r\n
- <api_token><\/strong> should be replaced with API Token<\/strong> we created for the user.<\/li>\r\n\r\n\r\n\r\n
- <authentication_token><\/strong> should be replaced with the API Token<\/strong>. If we want to trigger a parameterized job, replace the build with Buildwithparameters in the URL.<\/li>\r\n<\/ul>\r\n\r\n\r\n\r\n
2. Create S3 Bucket:<\/h4>\r\n\r\n\r\n\r\n
I have created an empty bucket named s3-test-Jenkins<\/strong>. This bucket will trigger the Lambda script if any file or folder is uploaded in this bucket.<\/p>\r\n\r\n\r\n\r\n3. Create Lambda Function:<\/h4>\r\n\r\n\r\n\r\n
I have created a lambda function<\/a> using the below steps:<\/p>\r\n\r\n\r\n\r\na).<\/strong> Go to Lambda >> create Function >> select Author From Scratch >>give function name >> select Python3.7 Runtime >> Create Function<\/strong><\/p>\r\n\r\n\r\n\r\n<\/figure>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n
Add the below code to the lambda function that was created in the above steps:<\/p>\r\n\r\n\r\n\r\n\r\n\r\n
import requests\r\nimport os\r\n \r\nUSERNAME = os.environ['USERNAME']\r\nJENKINS_URL = os.environ['JENKINS_URL']\r\nAPI_TOKEN = os.environ['API_TOKEN']\r\nAUTH_TOKEN = os.environ['AUTH_TOKEN']\r\n \r\n \r\ndef lambda_handler(event, context):\r\n try:\r\n url = \"http:\/\/{}:{}@{}\/build?token={}\".format(USERNAME, API_TOKEN, JENKINS_URL, AUTH_TOKEN)\r\n print(url)\r\n response = requests.post(url)\r\n if response.status_code != 201:\r\n print(response.status_code)\r\n except Exception as err:\r\n print(err.args[0])\r\n<\/code><\/pre>\r\n\r\n\r\n\r\n\r\n\r\nThese are the environment variables that you need to add the lambda function:<\/p>\r\n\r\n\r\n\r\n
b).<\/strong> Go to configuration<\/strong> >> Environment variables<\/strong> >> Add Environment Variable >>\u00a0Save<\/strong><\/p>\r\n\r\n\r\n\r\n<\/figure>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n
Add trigger into lambda function:<\/p>\r\n\r\n\r\n\r\n
c). Function >> select Add trigger >>Trigger configuration >> select s3 >> Bucket Name >> Event type >>Add<\/strong><\/p>\r\n\r\n\r\n\r\n<\/figure>\r\n\r\n\r\n\r\n\r\n\r\n <\/p>\r\n
In this blog, we have seen how in a few easy steps we can trigger AWS Lambda through an S3 event and trigger Jenkins through AWS Lambda. I hope this blog will help you if any such scenario comes up. Happy learning!<\/p>\r\n\r\n\r\n\r\n\r\n\r\n
Blog Pundits: Deepak Gupta<\/a><\/strong> and Sandeep Rawat<\/a><\/strong><\/p>\r\n\r\n\r\n\r\nRelated Searches – AWS Consulting Partner<\/a> | Cloud Engineering Services<\/a><\/strong><\/p>\r\n\r\n\r\n\r\n
<\/figure>\r\n\r\n\r\n\r\n<\/p>\r\n\r\n\r\n\r\n
Steps:<\/h2>\r\n\r\n\r\n\r\n1. Generate API Token Token:<\/h4>\r\n\r\n\r\n\r\n
We need to generate an API token for the user which we will use to authenticate the API call to trigger the job<\/p>\r\n\r\n\r\n\r\n
a).<\/strong> Go to People >> User-Name >> Configure >> Add New Token under API Token >> Generate >> Save<\/strong><\/p>\r\n\r\n\r\n\r\n Now we need to add the authentication token to the job we want to trigger remotely.<\/p>\r\n\r\n\r\n\r\n Note<\/strong>: API token is equal to the Authentication token<\/p>\r\n\r\n\r\n\r\n b). <\/strong>Go to job >> Configure >> Trigger builds remotely under Build Triggers >> add API Token to Authentication Token Field >> Save<\/strong><\/p>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n With this information, you can now create a URL that looks like this:<\/p>\r\n\r\n\r\n\r\n http:\/\/user-name<\/strong>:<api_token>@jenkins-web-url.com\/job\/<JobName>\/build?token=<authentication_token><\/strong><\/p>\r\n\r\n\r\n\r\n I have created an empty bucket named s3-test-Jenkins<\/strong>. This bucket will trigger the Lambda script if any file or folder is uploaded in this bucket.<\/p>\r\n\r\n\r\n\r\n I have created a lambda function<\/a> using the below steps:<\/p>\r\n\r\n\r\n\r\n a).<\/strong> Go to Lambda >> create Function >> select Author From Scratch >>give function name >> select Python3.7 Runtime >> Create Function<\/strong><\/p>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n Add the below code to the lambda function that was created in the above steps:<\/p>\r\n\r\n\r\n\r\n\r\n\r\n These are the environment variables that you need to add the lambda function:<\/p>\r\n\r\n\r\n\r\n b).<\/strong> Go to configuration<\/strong> >> Environment variables<\/strong> >> Add Environment Variable >>\u00a0Save<\/strong><\/p>\r\n\r\n\r\n\r\n <\/p>\r\n\r\n\r\n\r\n Add trigger into lambda function:<\/p>\r\n\r\n\r\n\r\n c). Function >> select Add trigger >>Trigger configuration >> select s3 >> Bucket Name >> Event type >>Add<\/strong><\/p>\r\n\r\n\r\n\r\n <\/p>\r\n In this blog, we have seen how in a few easy steps we can trigger AWS Lambda through an S3 event and trigger Jenkins through AWS Lambda. I hope this blog will help you if any such scenario comes up. Happy learning!<\/p>\r\n\r\n\r\n\r\n\r\n\r\n Blog Pundits: Deepak Gupta<\/a><\/strong> and Sandeep Rawat<\/a><\/strong><\/p>\r\n\r\n\r\n\r\n Related Searches – AWS Consulting Partner<\/a> | Cloud Engineering Services<\/a><\/strong><\/p>\r\n\r\n\r\n\r\n\r\n
2. Create S3 Bucket:<\/h4>\r\n\r\n\r\n\r\n
3. Create Lambda Function:<\/h4>\r\n\r\n\r\n\r\n
import requests\r\nimport os\r\n \r\nUSERNAME = os.environ['USERNAME']\r\nJENKINS_URL = os.environ['JENKINS_URL']\r\nAPI_TOKEN = os.environ['API_TOKEN']\r\nAUTH_TOKEN = os.environ['AUTH_TOKEN']\r\n \r\n \r\ndef lambda_handler(event, context):\r\n try:\r\n url = \"http:\/\/{}:{}@{}\/build?token={}\".format(USERNAME, API_TOKEN, JENKINS_URL, AUTH_TOKEN)\r\n print(url)\r\n response = requests.post(url)\r\n if response.status_code != 201:\r\n print(response.status_code)\r\n except Exception as err:\r\n print(err.args[0])\r\n<\/code><\/pre>\r\n\r\n\r\n\r\n\r\n\r\n