John Hawkins

John Hawkins

Data Scientist & Machine Learning Researcher

Will your job be automated out of existance by AI?

less than 1 minute read

Published:

Are you feeling anxious about whether your career is in danger of being automated out of existence?

You are not alone.

The growing concern is reflected in the numerous recently published studies from consulting firms like McKinsey or NGOs like the World Economic Forum and academic studies like this one from Oxford University. Unfortunately these ideas tend to make it to the public through many purveyors of click-bait and we end up with wide-spread distribution of info-graphics or cute new web applications with all of the subtlety in the original reports removed.

Each of the original studies makes many assumptions and draws attention to the complexity of forecasting the impact of technology on employment. The difficulty stems from the existence of many factors affecting the practicality of both building an AI system and then integrating it into an organisation.

Read More

You May Also Enjoy

textplainer : Intuitive explanations for text based machine learning models

less than 1 minute read

Published:

Text data is a powerful a useful source of signal in machine learning systems. There are a set of very standard approaches to dealing with raw text to prepare it for machine learning and statistics. We routinely use: bag of words and n-gram models, TF-IDF, topic modelling or potentially word embeddings derived from one of the neural network language models like Word2Vec, GloVe or fastText. All of these approaches have proven themselves as effective text pre-processing techniques that require no domain knowledge and are widely applicable.

texturizer : Exploring diverse text derived features for machine learning

3 minute read

Published:

Text data is a fascinating source of information for data scientists. It can betray subtle clues as to the mood, motives and behaviours of people, in both conscious and unconscious expressions. We can extract text from a wide variety of sources: internal documents, email records, web forms, social media posts, and even the text descriptions from financial transactions.

dfsummarizer : A command line application for summarizing data frames

less than 1 minute read

Published:

Summarizing data is one of those small tasks that data scientists and analysts need to do routinely. However, we often need to write bespoke scripts to get exactly what we want, coping with missing values and assorted data types. We then need to go through a tedious process to format it for sharing or publication.