online courses Archives - DexLab Analytics | Credit Risk | Market Risk | SAS Python Machine Learning Modeling

Complete Guide to Credit Risk Modeling Techniques

Complete Guide to Credit Risk Modeling Techniques

A practical framework for PD, LGD, EAD and expected loss modeling in banking

Introduction

Between March 2018 and March 2021, gross non-performing assets at India’s public sector banks fell from a peak of 14.58% to 9.11% of advances. By September 2025, the system-wide gross NPA ratio for all scheduled commercial banks had dropped further, to a multi-decade low of 2.15%. That turnaround wasn’t accidental. Tighter underwriting, RBI’s Asset Quality Review, the Insolvency and Bankruptcy Code, and — underlying all of it — better credit risk models drove it.

The lesson for anyone building a career in banking analytics is straightforward. Credit risk is the single largest risk category banks carry on their balance sheets. How well a bank measures it directly determines capital adequacy, profitability, and long-term survival. A bank that underestimates default risk lends into losses it didn’t provision for. A bank that overestimates it prices good borrowers out of the market and loses share to competitors.

This guide walks through the complete framework professionals use to model credit risk. It covers the regulatory logic that makes credit risk modeling non-negotiable. It covers the three parameters that quantify it — PD, LGD, EAD. And it covers the statistical and machine learning techniques used to estimate each one. Maybe you’re a risk analyst preparing for an FRM exam. Maybe you’re a data scientist moving into banking analytics. Maybe you’re evaluating a credit risk modeling certification. Either way, this article builds the structured foundation technical interviews and real project work both expect.

By the end, you’ll understand the formulas. You’ll understand why each one exists, how professionals estimate it in practice, and where Indian banks apply it today.

What is Credit Risk and Why It Matters

Credit risk is the possibility that a borrower fails to meet a contractual debt obligation. The borrower could be an individual, a company, or a counterparty. Either way, it results in a financial loss for the lender. It is the risk that repayment doesn’t happen as agreed: a missed EMI, a defaulted corporate bond, a counterparty that can’t settle a derivative contract.

For a bank, credit risk isn’t one risk among many — it’s usually the dominant one. Loans and advances typically make up the largest share of a bank’s assets. Under the Basel framework, credit risk-weighted assets (RWA) form the biggest component of the capital a bank must hold. When credit risk is mismeasured, everything built on top of that measurement goes wrong too: capital adequacy ratios, loan pricing, provisioning, dividend capacity.

Why Credit Risk Modeling Matters to a Bank’s Survival

Three consequences flow directly from how well a bank models credit risk:

  1. Capital adequacy. Under Basel III, banks must hold capital proportional to the risk-weighted value of their assets. The Capital-to-Risk-Weighted-Assets Ratio (CRAR) for India’s scheduled commercial banks stood at a strong 17.2% as of September 2025 — well above the regulatory minimum. Risk measurement and provisioning discipline improved sharply after 2015, and it shows.
  2. Provisioning under IFRS 9. IFRS 9 replaced the incurred-loss model with an expected credit loss (ECL) model. Banks must now recognize losses before a default happens, based on modeled probabilities. That makes credit risk models a direct input into the profit and loss statement, not just a back-office risk tool.
  3. Pricing and portfolio strategy. A bank that can accurately rank borrowers by risk can price loans correctly, set appropriate limits, and choose which segments to grow or shrink. A bank that can’t ends up either losing good customers to competitors with sharper pricing, or accumulating bad loans that eventually show up as NPAs.

The RBI Regulatory Backdrop

The Reserve Bank of India has steadily tightened the credit risk framework banks operate under. Its 2015 Asset Quality Review forced transparent recognition of stressed assets that restructuring had previously hidden. More recently, in November 2023, the RBI raised risk weights on unsecured consumer credit — from 100% to 125% for banks. NBFC exposures saw a further increase. The goal: curb underpriced risk-taking in retail lending. The RBI has also begun articulating principle-based guidance for AI use in credit decisioning through its evolving regulatory framework. Model governance, not just model accuracy, is now squarely on the regulator’s radar.

This regulatory environment is precisely why credit risk modeling has become a core competency banks and NBFCs actively hire for — not an optional analytics add-on.

Core Components of Credit Risk Modeling

Every credit risk model, regardless of the statistical technique behind it, answers one question: how much money could the bank lose on this exposure, and how likely is that loss?

The industry-standard approach breaks “expected loss” into three independently modeled components:

1. Probability of Default (PD)

PD is the likelihood that a borrower will fail to meet their obligations within a defined time horizon. That’s typically 12 months for regulatory capital purposes, or lifetime PD under IFRS 9 for certain asset stages. PD is expressed as a percentage. A PD of 3% means a 3% chance of default within the horizon, based on the borrower’s characteristics.

2. Loss Given Default (LGD)

Default doesn’t always mean total loss. If a borrower defaults, the bank usually recovers something — through collateral liquidation, guarantees, or restructuring. LGD is the proportion of the exposure the bank expects to actually lose after recoveries. It’s expressed as a percentage of the exposure. An LGD of 40% means that, on average, the bank recovers 60% of what it’s owed after a default.

3. Exposure at Default (EAD)

EAD is the total value the bank carries at the moment of default — not the sanctioned limit, but the amount actually outstanding. For a term loan, this is close to the outstanding balance. Revolving facilities like credit cards or cash credit limits work differently. There, EAD must account for the possibility that the borrower draws down more of the limit before defaulting.

Putting It Together: Expected Loss

These three parameters combine into the foundational credit risk formula:

Expected Loss (EL) = PD × LGD × EAD

Consider a simple example: a bank has an outstanding exposure (EAD) of ₹1 crore to a borrower with a PD of 4% and an LGD of 45%.

Expected Loss = 0.04 × 0.45 × ₹1,00,00,000 = ₹1,80,000

This ₹1.8 lakh isn’t a one-off loss estimate for a single account. It’s the amount the bank should provision for, on average, across a portfolio of similar loans. Multiply this calculation across thousands of accounts, segmented by product, geography, and borrower type. The result is a portfolio-level expected loss figure that feeds directly into provisioning, pricing, and capital planning.

Why This Formula Is a Simplification

EL = PD × LGD × EAD is the standard, industry-wide formula — it’s not wrong. But it rests on an assumption worth naming explicitly: that PD, LGD, and EAD are independent of one another. In reality they aren’t. Recoveries tend to get worse exactly when default rates spike, because both track the same macroeconomic cycle. A recession depresses collateral values and pushes more borrowers into default at the same time. Multiplying three independent point estimates understates loss in exactly the scenarios that matter most. That’s why regulators require downturn LGD and downturn EAD/CCF add-ons rather than accepting benign-cycle averages.

From Single-Period EL to Lifetime ECL

The formula above is also a single-period number, typically 12 months. Under IFRS 9, lifetime ECL for Stage 2 and Stage 3 assets isn’t one multiplication. It’s a discounted sum of marginal expected losses across every remaining period of the loan’s life:

Lifetime ECL = Σₜ (marginal PDₜ × LGDₜ × EADₜ) × discount factorₜ

That distinction matters in practice. A 12-month EL figure and a lifetime ECL figure for the same loan can differ substantially. Conflating the two is a common — and consequential — modeling error.

Each of the three components — probability of default, loss given default, and EAD — demands its own data, statistical techniques, and validation standards. Getting the overall expected loss number right depends entirely on getting each of these three right individually. It also depends on staying honest about where the simplifying assumptions break down.

Probability of Default (PD) Estimation

PD estimation is where most credit risk modeling careers begin, because it has the richest data history and the most mature statistical toolkit.

The Data Foundation

PD models draw on historical loan performance data: borrower demographics, financial ratios, repayment history, bureau scores (like CIBIL in India), and macroeconomic variables. The target variable is binary. Did the borrower default within the observation window, typically defined as 90 days past due (DPD), or not?

Method 1: Logistic Regression

Logistic regression remains the industry workhorse for PD modeling, and for good reason. It’s interpretable, regulator-friendly, and produces a probability output directly — exactly what PD requires.

The logistic regression model estimates:

PD = 1 / (1 + e^-(β₀ + β₁X₁ + β₂X₂ + … + βₙXₙ))

X₁ through Xₙ are borrower characteristics: debt-to-income ratio, bureau score, vintage, loan-to-value ratio, and so on. Analysts estimate the β coefficients from historical default data.

Worked example: Suppose a simplified model uses two variables — bureau score and debt-to-income (DTI) ratio — and produces this equation:

Logit(PD) = -3.5 + (-0.02 × Bureau Score) + (2.1 × DTI)

For a borrower with a bureau score of 720 and a DTI of 0.35:

Logit(PD) = -3.5 + (-0.02 × 720) + (2.1 × 0.35) = -3.5 − 14.4 + 0.735 = -17.165

PD = 1 / (1 + e^17.165) ≈ 0.00003, or effectively near-zero risk — consistent with a strong bureau score and moderate leverage.

In practice, banks convert these raw PD outputs into a credit scorecard. It’s a points-based system: each variable band — score range, income bracket, tenure — contributes points that sum to a final score. That score maps back to a PD and a risk grade, AAA to D for instance. Most retail lending decision engines run on exactly this system.

Method 2: Survival Analysis

Logistic regression answers “will this borrower default within 12 months?” It doesn’t naturally answer “when.” Survival analysis models the time to default instead, using techniques like the Cox Proportional Hazards model or Kaplan-Meier estimation. It treats default as an “event.” It treats non-defaulted, still-active loans as “censored” observations.

This matters for two practical reasons. First, it lets banks estimate lifetime PD curves, which IFRS 9 requires for Stage 2 and Stage 3 assets. Second, it naturally handles loans that are still performing at the end of the observation period. It doesn’t treat them as “non-defaults” the way a simple logistic model would. That subtlety matters a great deal in mortgage and long-tenure corporate lending portfolios.

Machine Learning Extensions

Random forests, gradient boosting (XGBoost, LightGBM), and neural networks increasingly supplement — not always replace — logistic regression. This works particularly well where alternative data is available: transaction behavior, digital footprint, utility payment history. Industry research on large Indian banks backs this up. ML models can improve default prediction accuracy over ratio-based or bureau-only assessments, particularly for thin-file borrowers without a long credit history. The trade-off is interpretability. Regulators and internal model validation teams expect PD models to be explainable. That’s why techniques like SHAP (SHapley Additive exPlanations) have become standard for justifying ML-based PD outputs to auditors and regulators.

Common Mistakes in PD Modeling

  • Treating bureau score as a sufficient standalone predictor without controlling for portfolio-specific behavior
  • Ignoring population stability — a PD model trained on pre-pandemic data can be badly miscalibrated for a post-pandemic portfolio
  • Failing to account for right-censoring when using a fixed observation window
  • Overfitting on a small default sample, which is common in low-default portfolios like corporate or sovereign lending

Loss Given Default (LGD) and Recovery

PD tells you whether a loss will happen. LGD tells you how big it will be once it does. Most practitioners consider it the harder of the two to model well. Default events are relatively rare, and recovery processes can take years to conclude.

What Drives LGD

LGD is shaped primarily by three factors:

  1. Collateral coverage and quality. A secured home loan with a well-documented, liquid property as collateral typically carries a far lower LGD than an unsecured personal loan. The reason: the bank has a tangible asset to recover value from.
  2. Seniority of claim. In corporate lending, senior secured lenders recover more than subordinated or unsecured creditors in a resolution or liquidation.
  3. Recovery mechanism and timeline. In India, recovery routes include SARFAESI Act enforcement, Debt Recovery Tribunals, and the Insolvency and Bankruptcy Code (IBC). These matter enormously for LGD estimation. IBC-driven recoveries have averaged around 94% of the fair value of resolved businesses, though considerably less against the original claim amount. System-wide NPA recovery rates for scheduled commercial banks have roughly doubled, from 13.2% in FY18 to 26.2% in FY25, reflecting stronger legal recovery infrastructure.

The Recovery Rate Relationship

LGD and recovery rate are two sides of the same coin:

LGD = 1 − Recovery Rate

That relationship is correct. But it’s easy to misapply, because “recovery rate” is doing a lot of work in that equation. It has to mean the economic recovery rate: the present value of net recoveries, after two adjustments. First, discount every recovered cash flow back to the default date, to account for the time value of money. Second, subtract the direct and indirect costs of recovery — legal fees, collateral liquidation costs, workout team overhead. A workout can take two to three years in India, even under IBC timelines. A rupee recovered in year three is worth meaningfully less than a rupee recovered on day one.

The common mistake: using the nominal recovery rate instead. That’s raw cash eventually recovered, divided by exposure, with no discounting and no cost deduction. It overstates the recovery rate and, by direct consequence, understates LGD. Say a bank nominally recovers 65% of exposure post-default, but that recovery arrives over three years and costs 8% of exposure in legal and liquidation expenses. The economic recovery rate falls well below 65%. The resulting LGD lands correspondingly higher than the naive “35%” the nominal figure would suggest.

Collateral Valuation

For secured lending, LGD modeling starts with realistic collateral valuation — not the value at origination, but the expected value at the time of liquidation, discounted for:

  • Market depreciation of the asset class (property, equipment, vehicles)
  • Haircut for forced-sale conditions versus fair market value
  • Time-to-recovery, since a three-year legal process erodes present value even if the nominal recovery is high
  • Direct recovery costs (legal fees, auctioneer fees, administrative costs)

Statistical Methods for LGD

  1. Workout LGD (the standard approach): Banks track every actual default in their historical data. They record all cash flows recovered post-default: collateral sale proceeds, settlement payments, guarantee invocations. Then they discount those cash flows back to the default date, using an appropriate discount rate, and net off recovery costs. This produces an empirical, account-level LGD. Analysts then average and segment it by product, collateral type, and vintage.
  2. Regression-based LGD models: Raw workout LGD is bounded between 0 and 1. It can occasionally exceed 1, when recovery costs surpass recoveries. Banks often use techniques suited to bounded outcomes instead. One option is beta regression. Another is a two-stage model: first predict whether any recovery occurs at all, then model the recovery amount conditional on recovery happening.
  3. Downturn LGD: Basel requires banks to estimate LGD under economic downturn conditions, not just average conditions, because collateral values and recovery rates both tend to fall exactly when default rates rise. This is a critical, frequently underestimated requirement. An LGD model calibrated only on benign-cycle data will understate loss severity in a stress scenario.

A Practical Note on LGD in Indian Retail Lending

For Indian home loans, LGD modeling relies heavily on loan-to-value (LTV) ratio at origination and current LTV, adjusted for property price movements. Property is the dominant recovery source here. Unsecured personal loans and credit cards work differently — they carry substantially higher and more volatile LGD, since recovery depends almost entirely on borrower cooperation, collection agency effectiveness, or write-off. That’s part of why the RBI’s 2023 risk-weight increase on unsecured credit targeted loss severity concerns explicitly.
<h2id=”exposure-at-default”>Exposure at Default (EAD) Calculation

EAD often gets treated as the “simple” component of the PD × LGD × EAD formula, but any product with a revolving or undrawn component needs its own careful modeling.

Why EAD Isn’t Just the Current Balance

For a fully drawn term loan, EAD is straightforward. It stays close to the outstanding principal balance at any point in time, adjusted for scheduled amortization. Products like credit cards, overdrafts, and cash credit facilities work differently. A borrower can draw down additional funds between the assessment date and the moment of default. A borrower approaching financial distress often draws their credit line closer to the limit right before defaulting. That means EAD tends to run higher than the current outstanding balance, for exactly the accounts where it matters most.

The Credit Conversion Factor (CCF)

To capture this, banks use the Credit Conversion Factor (CCF) — the proportion of the currently undrawn commitment they expect to see drawn down before default.

EAD = Current Outstanding Balance + (CCF × Undrawn Commitment)

Worked example: A borrower has a credit card with a sanctioned limit of ₹5,00,000. The current outstanding balance is ₹2,00,000, leaving an undrawn commitment of ₹3,00,000. Historical data shows that, on average, borrowers who eventually default draw down 60% of their remaining undrawn limit before the default event (CCF = 0.60).

EAD = ₹2,00,000 + (0.60 × ₹3,00,000) = ₹2,00,000 + ₹1,80,000 = ₹3,80,000

This runs meaningfully higher than the ₹2,00,000 current balance. The expected loss calculation should use the ₹3,80,000 figure, not the current balance.

How CCF Is Estimated

Banks typically estimate CCF empirically, using a cohort approach. They identify accounts that defaulted. They look back at each account’s utilization level 12 months before default. Then they measure how much of the then-undrawn limit got drawn down by the time of default. Averaging this ratio across the portfolio — segmented by product type and current utilization band — produces the CCF estimates that feed EAD models.

CCF runs highest for revolving retail products like credit cards and overdrafts. It runs near-zero for term loans with no undrawn component. Corporate revolving credit facilities and working capital limits also require dedicated CCF modeling. Distressed corporate borrowers frequently draw down committed but unused credit lines as a liquidity buffer before default becomes evident.

EAD Under Basel and IFRS 9

Under the Basel Internal Ratings-Based (IRB) approach, EAD estimation follows the same downturn-conditioning logic as LGD. CCFs should reflect what happens under stressed conditions, since utilization tends to spike precisely when the broader environment deteriorates. Under IFRS 9, EAD projections also need to extend across the lifetime of the facility for Stage 2 and Stage 3 exposures, not just a fixed 12-month window.

Real-World Implementation in Banking

The theory behind PD, LGD, and EAD only matters if it translates into disciplined implementation. India’s banking sector over the past decade offers a clear illustration of what that looks like at scale.

The Turnaround in Numbers

Following the RBI’s 2015 Asset Quality Review, public sector banks’ gross NPA ratio rose sharply, as transparent recognition brought hidden stress to light. It peaked at 14.58% in March 2018. What followed was a sustained, model-driven cleanup. Recapitalization, tighter underwriting standards, and the Insolvency and Bankruptcy Code combined to bring the PSB gross NPA ratio down to 9.11% by March 2021, and further to 2.58% by March 2025. System-wide, across all scheduled commercial banks, the gross NPA ratio reached a multi-decade low of around 1.8%–2.15% through late 2025 and into 2026, per the RBI’s Financial Stability Report.

At the institution level, this shows up clearly in individual bank results. For the quarter ended March 2026, State Bank of India — India’s largest lender — reported a gross NPA ratio of 1.49% and a net NPA ratio of 0.39%. HDFC Bank reported a gross NPA ratio of 1.15% and net NPA ratio of 0.38%. These aren’t accidents of a benign credit cycle alone. They reflect years of investment: early warning systems, scorecard-based underwriting, stressed-asset monitoring infrastructure.

What Changed Operationally

Three implementation shifts are consistently cited across the sector:

  1. Early Warning Systems (EWS). Public sector banks have rolled out automated EWS frameworks with roughly 80 distinct triggers. These pull in third-party data to flag stress in borrowing accounts before they slip into NPA status. This shifts credit risk management from reactive classification to proactive monitoring.
  2. Machine learning-augmented scorecards. Industry research examining major Indian banks — SBI, HDFC, ICICI, Kotak Mahindra — found that machine learning techniques consistently outperform pure ratio-based or bureau-score-only assessments. The winning combination: logistic regression alongside random forests and neural networks, incorporating alternative data like transaction behavior and digital usage patterns. It works especially well for borrowers with thin credit files.
  3. Faster, more granular underwriting. The same research found loan approval times at many Indian banks have compressed, from several days to a matter of minutes for eligible segments. Automated, model-based decisioning drives this, rather than manual file review. That shift only became possible once PD and exposure models earned enough validated trust to run with minimal manual override.

The Governance Layer

None of this works without governance. The RBI’s ongoing regulatory review — including its recently articulated principle-based framework for AI use in banking — signals something important. As banks lean further into ML-driven credit risk models, model validation, explainability, and monitoring will matter as much as raw predictive accuracy. A model that can’t be explained to an auditor or regulator can’t be deployed at scale in a regulated balance sheet, no matter how well it performs statistically.

Interview Questions to Test Your Understanding

  1. Write out the expected loss formula and explain what each component represents.
  2. Why is logistic regression still preferred over more complex ML models for regulatory PD models?
  3. What’s the difference between workout LGD and downturn LGD, and why does Basel require the latter?
  4. Explain why EAD for a credit card is typically higher than the current outstanding balance.
  5. How would you validate a PD model’s performance? (Hint: think Gini coefficient, KS statistic, and calibration testing.)

Summary

Credit risk modeling breaks down a complex question: how much could a bank lose, and how likely is it? It splits that question into three independently estimated, rigorously validated components — Probability of Default, Loss Given Default, and Exposure at Default — combined through EL = PD × LGD × EAD. Analysts typically estimate PD through logistic regression and survival analysis, increasingly supplemented by explainable machine learning. LGD depends on collateral quality, recovery mechanisms, and downturn conditions. EAD requires modeling credit conversion factors for any revolving exposure. Together, these three parameters drive capital adequacy, IFRS 9 provisioning, and loan pricing. India’s banking sector’s asset quality turnaround over the past decade proves the point: disciplined credit risk modeling delivers at scale.

Frequently Asked Questions

Q1. What is the difference between credit risk and credit risk modeling?

Credit risk is the underlying possibility of borrower default. Credit risk modeling is the quantitative discipline of measuring that risk. It uses statistical and machine learning techniques to estimate PD, LGD, and EAD, so a bank can price, provision for, and manage the risk.

Q2. Is credit risk modeling the same as credit scoring?

Credit scoring is a subset of credit risk modeling, focused specifically on PD estimation for underwriting decisions. Full credit risk modeling also covers LGD, EAD, portfolio-level expected loss, stress testing, and regulatory capital calculation.

Q3. Which technique is better for PD modeling: logistic regression or machine learning?

Neither wins universally. Logistic regression remains preferred for regulatory capital models, thanks to its interpretability and regulator familiarity. Machine learning models can improve accuracy, particularly with alternative data. But they require additional explainability tooling — like SHAP — to meet governance and audit requirements.

Q4. What skills do I need to build a career in credit risk modeling?

You need statistics (logistic regression, survival analysis), proficiency in Python or SAS, familiarity with Basel and IFRS 9, and hands-on exposure to real credit datasets. Structured training that pairs regulatory context with practical model-building is generally the fastest path in.

Q5. How is credit risk modeling connected to IFRS 9?

IFRS 9 requires banks to recognize expected credit losses using forward-looking PD, LGD, and EAD estimates, rather than waiting for an actual default. Stage 1 assets use a 12-month figure, close to the standard EL = PD × LGD × EAD calculation. Stage 2 and 3 assets use lifetime ECL instead — a discounted sum of marginal expected losses across the loan’s remaining life, not a single multiplication.

Ready to Build These Skills Hands-On?

Understanding the theory behind PD, LGD, and EAD is the first step. Building bankable, interview-ready models — in Python or SAS, on real credit datasets, aligned to Basel and IFRS 9 — is what actually moves a career forward.

Explore Dexlab Analytics’ Credit Risk Modeling certification program to build PD, LGD, and EAD models from scratch, work through IFRS 9 ECL frameworks, and learn model validation techniques used by practicing risk teams.

 


.

Time Series Analysis & Modelling with Python (Part II) – Data Smoothing

dexlab_time_series

Data Smoothing is done to better understand the hidden patterns in the data. In the non- stationary processes, it is very hard to forecast the data as the variance over a period of time changes, therefore data smoothing techniques are used to smooth out the irregular roughness to see a clearer signal.

In this segment we will be discussing two of the most important data smoothing techniques :-

  • Moving average smoothing
  • Exponential smoothing

Moving average smoothing

Moving average is a technique where subsets of original data are created and then average of each subset is taken to smooth out the data and find the value in between each subset which better helps to see the trend over a period of time.

Lets take an example to better understand the problem.

Suppose that we have a data of price observed over a period of time and it is a non-stationary data so that the tend is hard to recognize.

QTR (quarter)Price
110
211
318
414
515
6?

 

In the above data we don’t know the value of the 6th quarter.

….fig (1)

The plot above shows that there is no trend the data is following so to better understand the pattern we calculate the moving average over three quarter at a time so that we get in between values as well as we get the missing value of the 6th quarter.

To find the missing value of 6th quarter we will use previous three quarter’s data i.e.

MAS =  = 15.7

QTR (quarter)Price
110
211
318
414
515
615.7

MAS =  = 13

MAS =  = 14.33

QTR (quarter)PriceMAS (Price)
11010
21111
31818
41413
51514.33
615.715.7

 

….. fig (2)

In the above graph we can see that after 3rd quarter there is an upward sloping trend in the data.

Exponential Data Smoothing

In this method a larger weight ( ) which lies between 0 & 1 is given to the most recent observations and as the observation grows more distant the weight decreases exponentially.

The weights are decided on the basis how the data is, in case the data has low movement then we will choose the value of  closer to 0 and in case the data has a lot more randomness then in that case we would like to choose the value of  closer to 1.

EMA= Ft= Ft-1 + (At-1 – Ft-1)

Now lets see a practical example.

For this example we will be taking  = 0.5

Taking the same data……

QTR (quarter)Price

(At)

EMS Price(Ft)
11010
211?
318?
414?
515?
6??

 

To find the value of yellow cell we need to find out the value of all the blue cells and since we do not have the initial value of F1 we will use the value of A1. Now lets do the calculation:-

F2=10+0.5(10 – 10) = 10

F3=10+0.5(11 – 10) = 10.5

F4=10.5+0.5(18 – 10.5) = 14.25

F5=14.25+0.5(14 – 14.25) = 14.13

F6=14.13+0.5(15 – 14.13)= 14.56

QTR (quarter)Price

(At)

EMS Price(Ft)
11010
21110
31810.5
41414.25
51514.13
614.5614.56

In the above graph we see that there is a trend now where the data is moving in the upward direction.

So, with that we come to the end of the discussion on the Data smoothing method. Hopefully it helped you understand the topic, for more information you can also watch the video tutorial attached down this blog. The blog is designed and prepared by Niharika Rai, Analytics Consultant, DexLab Analytics DexLab Analytics offers machine learning courses in Gurgaon. To keep on learning more, follow DexLab Analytics blog.


.

Time Series Analysis Part I

 

A time series is a sequence of numerical data in which each item is associated with a particular instant in time. Many sets of data appear as time series: a monthly sequence of the quantity of goods shipped from a factory, a weekly series of the number of road accidents, daily rainfall amounts, hourly observations made on the yield of a chemical process, and so on. Examples of time series abound in such fields as economics, business, engineering, the natural sciences (especially geophysics and meteorology), and the social sciences.

  • Univariate time series analysis- When we have a single sequence of data observed over time then it is called univariate time series analysis.
  • Multivariate time series analysis – When we have several sets of data for the same sequence of time periods to observe then it is called multivariate time series analysis.

The data used in time series analysis is a random variable (Yt) where t is denoted as time and such a collection of random variables ordered in time is called random or stochastic process.

Stationary: A time series is said to be stationary when all the moments of its probability distribution i.e. mean, variance , covariance etc. are invariant over time. It becomes quite easy forecast data in this kind of situation as the hidden patterns are recognizable which make predictions easy.

Non-stationary: A non-stationary time series will have a time varying mean or time varying variance or both, which makes it impossible to generalize the time series over other time periods.

Non stationary processes can further be explained with the help of a term called Random walk models. This term or theory usually is used in stock market which assumes that stock prices are independent of each other over time. Now there are two types of random walks:
Random walk with drift : When the observation that is to be predicted at a time ‘t’ is equal to last period’s value plus a constant or a drift (α) and the residual term (ε). It can be written as
Yt= α + Yt-1 + εt
The equation shows that Yt drifts upwards or downwards depending upon α being positive or negative and the mean and the variance also increases over time.
Random walk without drift: The random walk without a drift model observes that the values to be predicted at time ‘t’ is equal to last past period’s value plus a random shock.
Yt= Yt-1 + εt
Consider that the effect in one unit shock then the process started at some time 0 with a value of Y0
When t=1
Y1= Y0 + ε1
When t=2
Y2= Y1+ ε2= Y0 + ε1+ ε2
In general,
Yt= Y0+∑ εt
In this case as t increases the variance increases indefinitely whereas the mean value of Y is equal to its initial or starting value. Therefore the random walk model without drift is a non-stationary process.

So, with that we come to the end of the discussion on the Time Series. Hopefully it helped you understand time Series, for more information you can also watch the video tutorial attached down this blog. DexLab Analytics offers machine learning courses in delhi. To keep on learning more, follow DexLab Analytics blog.


.

Step-by-step guide to building a career in Data Science

Step-by-step guide to building a career in Data Science

With 2.5 quintillion bytes of data being created everyday companies are scrambling to build models and hire experts to extract information hidden in massive unstructured datasets and the data scientists have become the most sought-after professionals in the world.  The job portals are full of job postings looking for data scientists whose resume has the perfect combination of skill and experience. In this world which is being driven by the data revolution, achieving your big data career dreams need a little bit of planning and strategizing. So, here is a step-by-step guide for you.  

Grabbing a high paying and skilled data job is not going to be easy, industries will only invest money on individuals with the right skillset. Your job responsibility will involve wading through tons of unstructured data to find pattern and meaning, making forecasts regarding marketing trends, customer behavior and deliver the insight in a presentable format to the company on the basis of which they are going to be strategizing.

So, before you even begin make sure that you have the tenacity and enthusiasm required for the job. You would need to undergo Data science using python training, in order to gain the necessary skills and knowledge and since this is an evolving field you should be ready to constantly upskill yourself and stay updated about the latest developments in the field.

Are you ready? If it’s a resounding yes, then, without wasting any more time let’s get straight to the point and explore the steps that will lead you to become a data scientist.

Step 1: Complete education

Before you pursue data science, you must complete your bachelors degree, if you are coming from computer science, applied mathematics, or, economics that could give you a head start. However, you need to undergo Data Science training, post that to acquire the required skillset.

Step 2: Gain knowledge of Mathematics and statistics

You do not need to have a PHD in either, but, since both are at the core of the data science you must have a good grasp on applied mathematics and statistics. Your task would require you to have knowledge regarding linear algebra, probability & statistics. So, your first step would be to update yourself and be familiar with the concepts if you happen to hail from a non-science background so that you can sail through the rest of the journey.

 Step 3: Get ready to do programming

Just like mathematics and statistics, having a grip on a programming language preferably Python, is essential. Now, why do you need to learn coding? Well, coding is important as you have to work with large datasets comprising mostly unstructured data and coding will help you to clean, organize, read data and also process it. Now the stress is on Python because it is one of the widely used languages in the data science community and is comparatively easier to pick up.

Step 4: Learn Machine Learning

Machine learning plays a crucial role in data science as it helps finding patterns in data and making predictions. Mastering machine learning techniques would enable you develop algorithms for the models and create an automated system that enables you to make predictions in real-time. Consider undergoing a Machine Learning training gurgaon.

Step 5: Learn Data Munging, Visualization, and Reporting

It has been mentioned before that you would mostly be handling unstructured data, which means in order to process that data you must transform that data into a format that is easy to work with. Data munging helps you achieve that. Data visualization is again a must-have skill for a data scientist as it allows you to visually present your data findings that is easy to understand through graphs, charts, while data reporting lets you prepare and present reports for businesses.

Step 6: Be certified

Now that the field has advanced so much, there is a requirement for professionals who have undergone Data Science course. Doing a certification course would upskill you and arm you with industry knowledge. Reputed institutes like Dexlab Analytics offer cutting edge courses such as Python for data science training. If you just follow this step it would take care of the rest of the worries, the best part of getting your training is that here you will be taught everything from scratch so, no need to fret if you do not know programming language. Your learning would be aided by hands-on training.

Step 7: Practice your skills

You need to test the skills you have acquired and to hone the skills you must explore Kaggle, which lets your access resources you need and this platform also allows you to take part in competitions that further helps you sharpen your abilities. You should also keep on practicing by doing projects in order to put the theories into action.

Step 8: Work on your soft skills

In order to be a professional data scientist you must acquire soft skills as well. So along with working on your communication skills, you must also need to develop problem solving skills while learning how business organizations function to understand what would be required of you when you assume the role of a data scientist.

Step 9: Get an internship

Now that you have the skill and certification you need experience to get hired, build a resume stressing on the skills you have acquired and search the job portals to land an internship. It would not only enhance your resume, but, it also gives you exposures to real projects, the more projects you handle the better and you would also learn from the experts there.

Step 10: Apply for a job

Once you have gathered enough experience start applying for full-time positions as now you have both skill and experience. But, do not stop learning once you land a job, because this field is growing many changes will happen so you have to mold yourself accordingly. Be a part of the community, network with people, keep on exploring  GitHub and find out what other skills you require.

Data Science Machine Learning Certification

So, those were the steps you need to follow to build a rewarding career in data science. The job opportunities are plenty and to grab the right job you must do big data training in gurgaon. These courses are aimed to prepare individuals for the industry, so get ready for an exciting career!


.

DexLab Analytics Rated One of The Best Institutes in India

DexLab Analytics Rated One of The Best Institutes in India

Analytics India Magazine (AIM), one of the foremost journals on big data and AI in India, has rated Dexlab Analytics’ credit risk modelling course one of the best in India and recommended it be taken up to learn the subject in 2020. Dexlab Analytics is on AIM’s list of nine best online courses on the subject.

In an article, the AIM has rated DexLab Analytics as a premier institute offering a robust course in credit risk modelling. Credit risk modelling is “the analysis of the credit risk that helps in understanding the uncertainty that a lender runs before lending money to borrowers”.

The article describes the Dexlab Analytics course as offering learners “an opportunity to understand the measure of central tendency theorem, measures of dispersion, probability theory and probability distribution, sampling techniques, estimation theory, types of statistical tests, linear regression, logistic regression. Besides, you will learn the application of machine learning algorithms such as Decision tree, Random Forest, XGBoost, Support Vector Machine, banking products and processes, uses of the scorecard, scorecard model development, use of scorecard for designing business strategies of a bank, LGD, PD, EAD, and much more.”

The other bodies offering competent courses on the subject on AIM’s list are Udemy, SAS, Redcliffe Training, EDUCBA, Moneyweb CPD HUB, 365 DataScience and DataCamp.

Analytics India Magazine chronicles technological progress in the space of analytics, artificial intelligence, data science & big data by highlighting the innovations, players, and challenges shaping the future of India through promotion and discussion of ideas and thoughts by smart, ardent, action-oriented individuals who want to change the world.

Since 2012, Analytics India Magazine has been dedicated to passionately championing and promoting the analytics ecosystem in India. We have been a pre-eminent source of news, information and analysis for the Indian analytics ecosystem, covering opinions, analysis, and insights on key breakthroughs and future trends in data-driven technologies as well as highlighting how they’re being leveraged for future impact.

Data Science Machine Learning Certification

Dexlab Analytics has been thriving as one of the prominent institutes offering the best selection of courses on Big Data Hadoop, R Programming, Python, Business Analytics, Data Science, Machine Learning, Deep Learning, Data Visualization using Tableau and Excel. Moreover, it aims to achieve Corporate Training Excellence with each training it conducts.

For more information on this, click here – www.prlog.org/12826797-dexlab-analytics-listed-as-one-of-the-best-institutes-in-india.html

 


.

AI-Smart Assistants: A New Tech Revolution in the Make

2018 has begun. And this year is going to witness a mega revolution in the field of technology – the rise of AI-powered digital assistants. Striking improvements in key technologies, like natural language processing and voice recognition are making smart assistants more productive, helping us use electronic devices just by interacting with them.

 
AI-Smart Assistants: A New Tech Revolution in the Make
 

Smart voice assistants are going mainstream. From Apple’s Siri to Google’s Assistant to Samsung’s Bixby, superior digital assistants are on a quest to make our lives easier, while taking us a step closer to a world where each one of us will have our own personal, 24/7 –all-ears AI assistants to fulfill our every wish and command.

Continue reading “AI-Smart Assistants: A New Tech Revolution in the Make”

Microsoft Excel is Revamping Itself and We Can’t be Happier

Good News: Your favorite Microsoft Excel is about to get a lot smarter, and tech-savvy.

 
Microsoft Excel is Revamping Itself and We Can’t be Happier
 

How? Thanks to machine learning and improved connection with the outside world.

 

Recently, Microsoft’s general manager for Office, Jared Spataro and company’s director of Office 365 ecosystem marketing, Rob Howard talked about how Excel is soon going to understand more about the inputs given and drag out additional information from the internet, as and when deemed necessary.

Continue reading “Microsoft Excel is Revamping Itself and We Can’t be Happier”

How Can You Improve Your Business Figures with Data Lakes

Today, data lakes are springing up here and there. And with that, the composition structure of data lakes is changing. As more and more data are moving towards cloud, data lakes are shifting focus towards cutting edge sources, like NoSQL, while cloud data warehouses are emerging across hybrid deployments.

How Can You Improve Your Business Figures with Data Lakes

A humongous amount of data is being churned out on digital platform each day. IBM says as much as 2.5 quintillion bytes of data is created on a daily basis. Now, this ever-expanding amount of data needs for proper storage system – for that, data lakes have been constructed to hold data in its raw form. In these vast storehouses, data remain mostly in their unstructured state, which is pulled out by data scientists to remodel and transform them into versatile data sets for future use.

Continue reading “How Can You Improve Your Business Figures with Data Lakes”

Data Governance: How to Win Over Data and Rule the World

Data is the buzzword. It is conquering the world, but who conquers data: the companies that use them or the servers in which they are stored?

 

Data Governance: How to Win Over Data and Rule the World

 

Let’s usher you into the fascinating world of data, and data governance. FYI: the latter is weaving magic around the Business Intelligence community, but to optimize the results to the fullest, it needs to depend heavily on a single factor, i.e. efficient data management. For that, highly-skilled data analysts are called for – to excel on business analytics, opt for Business Analytics Online Certification by DexLab Analytics. It will feed you in the latest trends and meaningful insights surrounding the daunting domain of data analytics.

Continue reading “Data Governance: How to Win Over Data and Rule the World”

Call us to know more