My First End-to-End Text Mining and Analytics Project — from Scraping to Insights

Foreword

Learning the various techniques for analyzing text to extract useful insights and patterns to support decision making as a part of my 1-year Nanyang Poly’s specialist diploma in big data analytics, I worked on a NLP Project which explored the possibilities reading a movie’s plot like a data set to predict whether it is a box-office hit.

Project Objectives

I and my 3 course mates (Alex, Belinda and Liduina) formed a pseudo start-up company — Reelly Good Productions and the company objective as a filmmaker is to create original…


Foreword

Leveraging AI to improve work efficiency becomes one of manufacturing 4.0’s deliverables as we start to explore more ways to advance automation, control manufacturing processes remotely and enable a remote workforce. In the last several years, visual inspection technologies have been helping manufacturers to ease the operation pressures. computer vision is being used in quality inspection for electronics part, retail goods and even food products.

Project Objectives


Foreword

Loan defaulter prediction is one of the best and most common problems solved by Machine Learning. In one of Nanyang Poly’s specialist diploma projects, I and my team mates were trying to solve a similar credit risk problem — late repayment. Instead of utilizing python, the most common ML tool, we used RapidMiner, a data science software platform, for data preparation, training and testing.

Background

Since the global financial crisis, there has been a constant focus on the risk management in banks. There is an increasing influence of machine learning (ML) in business applications, with many solutions already implemented and many…

Li-Da Gan

IT Solution (ERP MFG & MES) Architect exploring the potential of Machine Learning to improve manufacturing processes. linkedin.com/in/ganlida

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store