3 years ago

DevOps:Roadmap: Very useful representation to understand tools and technologies used in DevOps : https://roadmap.sh/devopsTerminologies that every DevOps professional should be aware:Curated list of 100-best-devops-stories-of-2019:https://medium.com/faun/100-best-devops-stories-of-2019-faun-11d0c395cd75Internet and DNSHow does Internet work:https://www.youtube.com/watch?v=Dxcc6ycZ73M&list=PLkZYeFmDuaN21nQjzE4RLLNccK_YP0P0_Loading a webpage might take less than a second but these are the steps that happen underneath: https://medium.com/@maneesha.wijesinghe1/what-happens-when-you-type-an-url-in-the-browser-and-press-enter-bb0aa2449c1aHow DNS works:Really useful article to understand Route 53 better:Difference between CNAME and Alias record:https://help.ns1.com/hc/en-us/articles/360017511293-What-is-the-difference-between-CNAME-and-ALIAS-records-TerraformTerraform testing tools:https://terratest.gruntwork.io/docs/getting-started/quick-start/https://github.com/k1LoW/awspechttps://medium.com/@pb8226/running-terraform-with-jenkins-pipelines-f29a8cb861d4https://www.terraform.io/docs/cloud/sentinel/mock.htmlhttps://newcontext-oss.github.io/kitchen-terraform/https://kitchen.ci/Terrascan:https://www.cloudsecuritymusings.com/blog/using-terrascan-for-static-code-analysis-of-your-infrastructure-code-part-2https://www.helpnetsecurity.com/2020/08/18/terrascan-open-source-software/https://github.com/accurics/terrascanhttps://docs.accurics.com/projects/accurics-terrascan/en/latest/getting-started/https://devops.stackexchange.com/questions/863/how-to-test-a-terraform-configurationExample git hub project using terratest :https://github.com/mongodb/terraform-aws-ecs-task-definitionTypes of terraform testing that we can perform:Ma king terraform more DRYer:The terraform should have code for pre installed plugins so that there is no changehttps://learn.hashicorp.com/tutorials/terraform/automate-terraformCreating and using terraform workspaceshttps://medium.com/better-programming/managing-multiple-environments-in-terraform-5b389da3a2efPipeline automationImmutable infrastructure: This will eliminate issues caused by a hundred moving components that will give us the issue of it working in lower environment but not working in higher environmenthttps://medium.com/faun/immutable-infrastructure-and-image-factories-for-fun-and-profit-a25c0464be66DevSecOps pipelines setup: Good representation on setting up your CICD pipeline with Security steps — DevSecOps Automation with terraform using Jenkins:Deployment using terraform and code pipeline awshttps://medium.com/faun/terraform-deployments-with-aws-codepipeline-342074248843Deployment using cloud formation:https://medium.com/swlh/aws-cloudformation-managed-complete-ecs-infrastructure-including-ci-cd-pipeline-from-github-to-ecs-b833bb44e01cDeployment using jenkins file in ECS:Good example to test the deployment:https://github.com/lavaliere/game-of-life/blob/master/Jenkinsfilehttps://abakonski.com/creating-a-continuous-deployment-pipeline-using-bitbucket-jenkins-and-amazon-ecs-part-2-of-2/ECS automation using Jenkins + Ansible :Jenkins file for terraform plan and apply:https://github.com/andreistefanciprian/terraform-jenkins-pipeline/blob/master/Jenkinsfile.statichttps://medium.com/@timhberry/terraform-pipelines-in-jenkins-47267129ff06https://objectpartners.com/2016/06/01/automating-terraform-projects-with-jenkins/https://learn.hashicorp.com/terraform/development/running-terraform-in-automationVery neat pipleline examples :https://dzone.com/articles/immutable-infrastructure-cicd-using-hashicorp-terrhttps://gist.github.com/gazoakley/87dcc16d28fd05acda4ba0a4be5ac387https://github.com/TedSpinks/jenkins-tfe-examples/blob/master/terraform-cmd/JenkinsfileAdd manual changes to terraform code:https://medium.com/faun/3-tips-to-manage-drift-from-manual-changes-in-terraform-91b3395cfb5cIdeas for different CICD pipelines:https://medium.com/avmconsulting-blog/how-to-build-your-first-a#Cloudws-codepipeline-ci-cd-pipeline-c4127dab6394Storing secrets:https://blog.gruntwork.io/a-comprehensive-guide-to-managing-secrets-in-your-terraform-code-1d586955ace1Deployment using code build /deploy:https://medium.com/polarsquad/continuous-deployments-for-aws-infrastructure-without-trusting-a-third-party-ci-c6b140043bb6Declarative terraform Jenkins pipelineHas good examples on handling exception and user prompt :https://github.com/andnreistefanciprian/terraform-jenkins-pipeline/blob/master/Jenkinsfile.statichttps://medium.com/@timhberry/terraform-pipelines-in-jenkins-47267129ff06This shows cloud bees integration in Jenkins UI as wellHas better user prompthttps://gist.github.com/gazoakley/87dcc16d28fd05acda4ba0a4be5ac387https://github.com/TedSpinks/jenkins-tfe-examples/blob/master/terraform-cmd/JenkinsfileFlow diagram for the Jenkins pipeline to IAC set up https://objectpartners.com/2016/06/01/automating-terraform-projects-with-jenkins/Good error handlingSending messages to slack on success and failureUses scripted pipelinehttps://dzone.com/articles/immutable-infrastructure-cicd-using-hashicorp-terrJenkins certified engineer certification details:https://medium.com/@devopslearning/my-road-to-certified-jenkins-engineer-807ae52409a0Linux CLIUseful commands with CURL:Essential Linux commands:PYENV set up for handling multiple Python versions:Useful videos on SysAdmin tasks in Linux:Making sense of memory usage in Linux:Installing Java:https://computingforgeeks.com/how-to-install-java-11-on-centos-7-fedora-29-fedora-28/How SSH works:SSL :How SSL certs are submitted for CA verificationOne way and Mutual TLS explained:https://dzone.com/articles/implementing-one-way-and-two-way-ssl-mutual-authenAWSIAM Cross account roles explained:Validate Lambda Events:https://medium.com/cyberark-engineering/aws-lambda-event-validation-from-zero-to-hero-2ca950acd2eaRDS MySQL or Aurora MySql:Install AWS CLI:SSH password authentication to EC2:ECS deployments:https://medium.com/@aaron.kaz.music/monitoring-the-health-of-ecs-service-deployments-baeea41ae737https://medium.com/twodigits/ci-cd-pipeline-for-aws-ecs-fargate-958d5c29205dGetting secrets for task def from secrets manager:https://medium.com/swlh/how-to-securely-use-aws-secrets-manager-to-inject-secrets-into-ecs-using-infrastructure-as-code-ff2b39b420b6Montitoring ecs deployment :https://levelup.gitconnected.com/a-practical-guide-to-deploying-microservices-on-aws-6a8ddd298f7eECS- capacity provider eg:https://stackoverflow.com/questions/60056801/aws-ecs-capacity-provider-using-terraformScanning of container images in pipeline:https://medium.com/faun/container-security-101-scanning-images-for-vulnerabilities-8030af2441baSecret manager for storing secrets : https://codeburst.io/how-to-securely-use-aws-secrets-manager-to-inject-secrets-into-ecs-using-infrastructure-as-code-ff2b39b420b6AnsibleSimple and clear explanation:KubernetesCKA/CKAD exam preparation:When do you need to go for Kubernetes:Pictorial explanation of Kubernetes:Curated list of 70 best Kubernetes tutorialsNginxVery clear intro to Nginx:Optimizing Nginx configurations:https://blog.martinfjordvald.com/2011/04/optimizing-nginx-for-high-traffic-loads/https://www.nginx.com/blog/thread-pools-boost-performance-9x/https://www.revsys.com/12days/nginx-tuning/Understanding contexts in Nginx:Best practices:Rewrite rules in Nginx:https://www.journaldev.com/26864/nginx-rewrite-url-rulesUnderstanding proxy pass:JWT based validations in Nginx:https://dzone.com/articles/authenticating-api-clients-with-jwt-and-nginx-plushttps://www.nginx.com/blog/authenticating-api-clients-jwt-nginx-plus/?_ga=2.230276828.1397636340.1563439723-792238633.1548125240http://nginx.org/en/docs/http/ngx_http_auth_jwt_module.html?utm_source=authenticating-api-clients-jwt-nginx-plus&utm_medium=blog#variablesUsing an external end point to validate jwt:http://nginx.org/en/docs/http/ngx_http_auth_jwt_module.htmlValidation based on a username and password:http://nginx.org/en/docs/http/ngx_http_auth_basic_module.htmlValidation based on IP:http://nginx.org/en/docs/http/ngx_http_access_module.htmlEncryptionDifference between HS256 and SHA-256 :Understanding JWT tokens :https://medium.com/vandium-software/5-easy-steps-to-understanding-json-web-tokens-jwt-1164c0adfcec Written by