Improving Machine Learning Outcomes
Published:
Improving Machine Learning Outcomes Focusing on Framing, Timing, and Targets
Blog posts
2021
2020
textplainer : Intuitive explanations for text based machine learning models
Published:
Text data is a powerful a useful source of signal in machine learning systems. There are a set of very standard approaches to dealing with raw text to prepare it for machine learning and statistics. We routinely use: bag of words and n-gram models, TF-IDF, topic modelling or potentially word embeddings derived from one of the neural network language models like Word2Vec, GloVe or fastText. All of these approaches have proven themselves as effective text pre-processing techniques that require no domain knowledge and are widely applicable.
texturizer : Exploring diverse text derived features for machine learning
Published:
Text data is a fascinating source of information for data scientists. It can betray subtle clues as to the mood, motives and behaviours of people, in both conscious and unconscious expressions. We can extract text from a wide variety of sources: internal documents, email records, web forms, social media posts, and even the text descriptions from financial transactions.
dfsummarizer : A command line application for summarizing data frames
Published:
Summarizing data is one of those small tasks that data scientists and analysts need to do routinely. However, we often need to write bespoke scripts to get exactly what we want, coping with missing values and assorted data types. We then need to go through a tedious process to format it for sharing or publication.
2018
Will your job be automated out of existance by AI?
Published:
Are you feeling anxious about whether your career is in danger of being automated out of existence?
2017
Why all scientists are not data scientists
Published:
There is a meme you will see floating around the internet that comes in many forms, one version is shown in the header image above. It is part of the vague internet resistance to this new occupation. The response is somewhat justified, Data Scientist is a job title that requires no specific qualification, and garners differing opinions on what the core skill set is.
Mean Imputation in Apache Spark
Published:
If you are interested in building predictive models on Big Data, then there is a good chance you are looking to use Apache Spark. Either with MLLib or one of the growing number of machine learning extensions built to work with Spark such as Elephas which lets you use Keras and Spark together.