Batch Normalisation

Before we describe what Batch Normalisation is, here are a few introductory terms Internal covariate shift Stochastic Gradient Descent uses a minibatch of input to train the parameters of a layer. The input to a layer is the output from the previous layer. A change in the parameters of the previous layer causes a change … Read more

Distributed Machine Learning – Part 2 Architecture

Why Distributed Machine Learning? In the previous article we looked at how GPGPU, ASICS, AWS’s Inferentia, the new NVidia A100 chip and other advances in hardware have tremendously improved the performance of Machine Learning training and inference. However the increase in the volume of data and the increasing complexity of the machine learning models require … Read more

CloudFormation for SageMaker instance

Amazon SageMaker helps data scientists and Machine Learning developers build, train and deploy machine learning models. It includes Jupyter notebook to build and train model as well SageMaker API to train and deploy model with a few lines of code. Amazon CloudFormation helps in provisioning AWS resources using code. It automates provisioning and configuring resources … Read more

What is Kubernetes – simple Introduction

Kubernetes definition Kubernetes is an open source system for managing containerized applications and provides mechanisms to deploy, maintain and scale them accross multiple hosts spread accross on premise and cloud. It is more than a container orchestration platform because it also takes care of managing the compute, network and storage infrastructure What problems does Kubernetes … Read more

Kubernetes Kustomize for Multiple Environments

In the previous article we saw an introduction to the Kubernetes kustomize tool and how it can be used to configure YAML file used for deploying applications to Kubernetes. In this article we will look at how to use Kubernetes Kustomize for multiple environments. In a production setting , you might have multiple environments and … Read more