IQR, Standard Deviation, Z-score and Modified Z-score — Introduction It is risky to include outliers in data driven models. The existence of one single misleading value has the potential to change the conclusion implied by the model. Is is therefore, important to detect and then decide whether to remove it or not from the dataset. Sometimes the data…

Adjusted Boxplot for skewed distribution — Introduction In the pervious article, I have discussed about outlier detection procedures for mostly normal distributions. The procedures include IQR (Inter-Quartile Range) Standard deviation Z-score Modified Z-score We have gone through the boxplots after these abovementioned procedures are implemented and shown the number of outliers in each case. In real…

Use of Cook’s Distance in Scikit-Learn and Statsmodel for Regression Outlier Detection — Introduction Outliers are defined as abnormal values in a dataset that don’t go with the regular distribution and have the potential to significantly distort any regression model. Therefore, outliers must be carefully handled in order to get the right insight from the data. Usually, the data collected from real-world, consists…

IQR, Hampel and DBSCAN method — Outliers, one of the buzzwords in the manufacturing industry, has driven engineers and scientists to develop newer algorithms as well as robust techniques for continuous quality improvement. If the data include even if one outlier, it has the potential to dramatically skew the calculated parameters. Therefore, it is of utmost…

Principle and Future of ToF Cameras — Introduction Imagine what it would be like if a technical device could see what a human can. Whatever our experience is about our 3D world, if introduced into the sensing devices, there will be a revolution in perception technology that will further trigger enhanced photograph quality and open new doors…

The Golden Ratio Series — Introduction Golden Ratio can be constructed in geometry by a variety of ways. Since, this ratio has been utilized in many past structures, it created an excitement among the mathematicians to investigate this ratio. in this article, I will demonstrate a simple geometrical procedure to obtain this magical ratio. Golden…

James Webb Deepest Infrared Image in Layman’s Terms — Do you feel the excitement after looking at this heavenly image above or pass it for being a regular image of the sky? There are definitely these two categories of people existing right now. NASA has just revealed this ultra-deep infrared image collected by James Webb Space Telescope that shows…

Statistics in R Series — Introduction R is a very powerful programming language for statistical analyses. There are several programming platforms for statistical analysis but R has gained real attraction among data scientists and data analysts because of its inherent capability to perform statistical tasks better than others and deliver the visualizations more aesthetically. In…

The Golden Ratio Series — Introduction Our visual lives are impacted by a handful of mathematical concepts and the golden ratio is probably the most widely visualized but subtle one. In this series of articles, I will walk the readers through the wonders of golden ratio, often denoted by the Greek letter ф. Definition The…