{"id":146,"date":"2019-03-01T13:57:00","date_gmt":"2019-03-01T13:57:00","guid":{"rendered":"https:\/\/opstree.com\/blog\/\/2019\/03\/01\/its-not-you-everytime-sometimes-issue-might-be-at-aws-end\/"},"modified":"2025-11-24T16:41:56","modified_gmt":"2025-11-24T11:11:56","slug":"its-not-you-everytime-sometimes-issue-might-be-at-aws-end","status":"publish","type":"post","link":"https:\/\/opstree.com\/blog\/2019\/03\/01\/its-not-you-everytime-sometimes-issue-might-be-at-aws-end\/","title":{"rendered":"Its not you Everytime, sometimes issue might be at AWS End"},"content":{"rendered":"<div dir=\"ltr\" style=\"text-align: left;\">\n<p><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Today an issue reported to me that website of our client was loading very slow which was hosted on AWS Windows <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">server and the same website was loading fine when accessed from outside AWS network,I just felt like might be a <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">regular issue but it all together took me to an inside out of the network troubleshooting.<\/span><\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Initially, we checked for SSL certificate expiry, which was not the case, so below are the Two steps which we used to <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">troubleshoot the issue:<\/span><\/span><\/p>\n<h3 style=\"text-align: left;\">Troubleshooting through Browser via Web developer Network tool<\/h3>\n<p style=\"text-align: left;\"><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; white-space: pre-wrap;\">In browser we checked which part of <\/span>code<span style=\"font-size: 12pt; white-space: pre-wrap;\"> was taking time to load using Network option in developer tools:<\/span><\/span><\/p>\n<ul style=\"text-align: left;\">\n<li><span style=\"font-family: inherit; font-size: 12pt; white-space: pre-wrap;\">Select web developer tools in firefox<\/span><\/li>\n<li>Then select network<\/li>\n<\/ul>\n<p class=\"separator\" style=\"clear: both; text-align: center;\"><a style=\"margin-left: 1em; margin-right: 1em;\" href=\"https:\/\/opstree.com\/blog\/\/wp-content\/uploads\/2019\/03\/6079f-network.jpeg\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/opstree.com\/blog\/\/wp-content\/uploads\/2019\/03\/6079f-network.jpeg?w=300\" width=\"640\" height=\"340\" border=\"0\" \/><\/a><\/p>\n<p><span style=\"font-family: inherit; font-size: 12pt; white-space: pre-wrap;\">We identified one of the GET calls was taking time to load.<\/span><br \/>\n<span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Then when this thing was reported to AWS support team they provided further analysis of this. We can save the report <\/span>as (.<span style=\"font-size: 12pt; white-space: pre-wrap;\">HAR) file which tells us below things:<\/span><\/span><\/p>\n<ul style=\"text-align: left;\">\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">How long it takes to fetch DNS information<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">How long each object takes to be requested<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">How long it takes to connect to the server <\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">How long it takes to transfer assets from the server to the browser of each object.<\/span><\/li>\n<\/ul>\n<p style=\"text-align: left;\">Troubleshooting using Traceroute<\/p>\n<p style=\"text-align: left;\"><span style=\"font-family: inherit; font-size: 12pt; white-space: pre-wrap;\">Then we tried to troubleshoot the AWS network flow using &#8220;tracert &#8221; with below output:<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Tracing route to <\/span><a href=\"#\"><span style=\"color: #1155cc; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">example.gov<\/span><\/a><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\"> [151.x.x.x] <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">over a maximum of 15 hops:<\/span><\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">1 &lt;1 ms &lt;1 ms &lt;1 ms 10.x.x.x<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">2 * * * Request timed out.<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">3 * * * Request timed out.<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">4 * * * Request timed out.<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">5 * * * Request timed out.<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">6 * * * Request timed out.<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">7 &lt;1 ms &lt;1 ms &lt;1 ms 100.x.x.x<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">8 &lt;1 ms &lt;1 ms 1 ms 52.x.x.x<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">9 * * * Request timed out.<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">10 2 ms 1 ms 1 ms <\/span><a href=\"#\"><span style=\"color: #1155cc; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">example.net<\/span><\/a><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\"> [67.x.x.x]<\/span><\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">11 2 ms 2 ms 2 ms <\/span><a href=\"#\"><span style=\"color: #1155cc; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">example.net<\/span><\/a><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\"> [67.x.x.x]<\/span><\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">12 2 ms 2 ms 2 ms <a href=\"#\">example<\/a><\/span><span style=\"color: #1155cc; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">.net<\/span><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\"> [205.x.x.x]<\/span><\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">13 3 ms 3 ms 2 ms 63.x.x.x<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">14 3 ms 3 ms 3 ms 198.x.x.x<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: Courier New, Courier, monospace;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">15 4 ms 4 ms 4 ms <\/span><a href=\"#\"><span style=\"color: #1155cc; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">example.net<\/span><\/a><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\"> [63.x.x.x]<\/span><\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">And when this was reported to AWS team that RTO from 2-6 we were getting was due to connectivity with internal <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">AWS network which needs to be byepass and was not an issue as packet still reached the next server within 1ms.<\/span><\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Traceroute gives an insight to your network problem.<\/span><\/p>\n<ul style=\"text-align: left;\">\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">The entire path that a packet travels through<\/span><\/li>\n<li><span style=\"font-family: inherit;\">Names and identity of routers and devices in your path<\/span><\/li>\n<li><span style=\"font-family: inherit;\">Network Latency or more specifically the time taken to send and receive data to each devices on the path.<\/span><\/li>\n<\/ul>\n<p style=\"line-height: 1.38; margin-bottom: 2pt; margin-top: 12pt;\"><span style=\"font-size: large;\">Solution provided by AWS Team<\/span><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">After all the Razzle-Dazzle they just refreshed the network from their end and there was no more website latency after <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">that while accessing from AWS internal network. <\/span><\/span><\/p>\n<p style=\"line-height: 1.38; margin-bottom: 4pt; margin-top: 14pt;\"><span style=\"font-size: large;\">Tool recommended by AWS Support team for Network troubleshooting if the issue arises in future:<\/span><\/p>\n<p><b><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Wireshark<\/span><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\"> along with .har file using network in web-developer tools from browser.<\/span><\/span><\/b><\/p>\n<p><span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Wireshark is a network packet analyzer. A network packet analyzer will try to capture network packets and tries to <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">display that packet data as detailed as possible.<\/span><\/span><br \/>\n<span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">You could think of a network packet analyzer as a measuring device used to examine what\u2019s going on inside a <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">network cable, just like a voltmeter is used by an electrician to examine what\u2019s going on inside an <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">electric cable (but at a higher level, of course).<\/span><\/span><br \/>\n<span style=\"font-family: inherit;\"><span style=\"font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">In the past, such tools were either very expensive, proprietary, or both. However, with the advent of Wireshark, all that <\/span><span style=\"font-size: 12pt; white-space: pre-wrap;\">has changed.<\/span><\/span><\/p>\n<\/div>\n<div dir=\"ltr\" style=\"text-align: left;\">\n<p><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Wireshark is perhaps one of the best open source packet analyzers available today.<\/span><\/p>\n<p style=\"line-height: 1.38; margin-bottom: 2pt; margin-top: 12pt;\"><strong>Features<\/strong><\/p>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">The following are some of the many features Wireshark provides:<\/span><\/p>\n<ul style=\"text-align: left;\">\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Available for UNIX and Windows.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Capture live packet data from a network interface.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Open files containing packet data captured with tcpdump\/WinDump, Wireshark, and a number of other packet capture programs.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Import packets from text files containing hex dumps of packet data.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Display packets with very detailed protocol information.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Save packet data captured.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Export some or all packets in a number of capture file formats.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Filter packets on many criteria.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Search for packets on many criteria.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Colorize packet display based on filters.<\/span><\/li>\n<li><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">Create various statistics.<\/span><\/li>\n<\/ul>\n<p dir=\"ltr\" style=\"line-height: 1.38; margin-bottom: 0; margin-top: 0;\"><span style=\"font-family: inherit; font-size: 12pt; vertical-align: baseline; white-space: pre-wrap;\">\u2026 and a lot more!<\/span><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Today an issue reported to me that website of our client was loading very slow which was hosted on AWS Windows server and the same website was loading fine when accessed from outside AWS network,I just felt like might be a regular issue but it all together took me to an inside out of the &hellip; <a href=\"https:\/\/opstree.com\/blog\/2019\/03\/01\/its-not-you-everytime-sometimes-issue-might-be-at-aws-end\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Its not you Everytime, sometimes issue might be at AWS End&#8221;<\/span><\/a><\/p>\n","protected":false},"author":159458603,"featured_media":29900,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[1],"tags":[768739294,768739308,768739290,676319245,800],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/opstree.com\/blog\/wp-content\/uploads\/2025\/11\/DevSecOps-1.jpg","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pfDBOm-2m","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/posts\/146"}],"collection":[{"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/users\/159458603"}],"replies":[{"embeddable":true,"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/comments?post=146"}],"version-history":[{"count":7,"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/posts\/146\/revisions"}],"predecessor-version":[{"id":30059,"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/posts\/146\/revisions\/30059"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/media\/29900"}],"wp:attachment":[{"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/media?parent=146"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/categories?post=146"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/opstree.com\/blog\/wp-json\/wp\/v2\/tags?post=146"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}