Original article was published on Artificial Intelligence on Medium
The VC’s Guide to Machine Learning
“Artificial Intelligence began with an ancient wish to forge the Gods.”
In the singular words of Pamela McCorduck, Artificial Intelligence or AI stems from our desire to “forge the Gods”, a concept that has been around for thousands of years.
In the Greek mythology of “The Argonauts and the Quest for the Golden Fleece”, Jason — a mortal hero and leader of the Argonauts — searches for the “Golden Fleece” and along his arduous journey battles Talos — a gargantuan non-human made of solid bronze.
Representations of AI also appears in Judaism, Chinese, Japanese, and Indian Philosophy.
With the exponential adoption of intelligent voice assistants like Amazon’s Alexa and Apple’s Siri, it appears that AI is a fundamental part of human nature to expand beyond ourselves, an innate quality of humanity’s desire to be Boundless.
With this ancient human dream for both understanding and creating intelligence, let us dive into the wonderful world of Machine Learning or ML.
Machine Learning as Intelligent Representation
To truly understand Machine Learning is to truly understand Representation.
How we interpret and understand the world as human beings largely depend on our representation of reality (popularized as “mental models” by Charlie Munger).
Take for example the Geocentric Model vs. Heliocentric Model of our own Solar System.
As the complicated and nonsensical trajectories of the Geocentric or “Earth-center” model clearly shows above, having the correct representation (the Heliocentric or “Sun-center” model) makes a world of difference.
Likewise, think of Machine Learning as a gateway to the technological holy grail of perfect machine representation of reality — the gateway to the Technological Singularity.
If you truly understand this (with the preface that knowledge is radically distinct from understanding), all of the technical jargon and lengthy pitches by technical Founders will start to make perfect sense.
Today, I would like to highlight key achievements from decades of scientific research, and how we can apply this understanding to make better investment decisions with respect to early-stage companies in Machine Learning or the specialized field of Deep Learning.
Text using Recurrent Neural Networks
We all know and love Google Translate, the website that can instantly translate between 100+ different human languages as if by magic.
What is the technology behind Google Translate?
Without getting into the technical details, the key idea that has made Google Translate possible and the hundreds of other applications for many “AI-enabled Text” startups is Recurrent Neural Networks or RNNs.
Simply stated, RNNs are a simplified computer model of the basic building block of the human brain, the neuron.
What makes it smarter (the “recurrent” part) than other “neural networks” is that it continuously improves its internal model based on external feedback.
This is very similar to how a child learns to walk for the first time — the motor neurons work closely with the neurons in the pre-frontal cortex to sense and learn base on feedback.
Vision using Convolutional Neural Networks
What is the core technology behind this revolutionary industry?
You shouldn’t be surprised to learn that state-of-the-art Computer Vision technology relies on Machine Learning, and specifically a type of “neural network” called Convolutional Neural Networks or CNNs.
What are CNNs?
Think of them as a “spatially invariant” neural network.
What does that mean?
Spatial invariance is a simple idea that an object’s identity doesn’t change because of its position in an image or video.
With the latest CNNs being a ground-breaking “semantic segmentation” called “Gated Shape CNNS” — we are able to achieve Pixel-level classification of road obstacles.
Voice using Transformer Neural Networks
With a round of applause, we conclude with Machine Learning applications for Voice.
Transformers — not to be confused with the immense intergalactic robots from the American science fiction action films — are the technology behind Natural Language Processing, the heart of everything from Amazon’s Alexa and Apple’s Siri.
What are Transformers?
Transformers are a type of Deep Learning “neural network” architecture first introduced in 2017 that has exponentially advanced the field of Natural Language Processing or NLP.
Within getting into the technical details, Transformers consists of a novel computer architecture consisting of a set of “Encoders” chained together with a set of “Decoders.”
Think of them as a very clever, higher-level systems architecture of the recurrent neural networks we mentioned above.
Amusing tidbit: Google launched a Transformer project call BERT — named after the Muppet character from Sesame Street — that has been trained with huge amounts of voice data and a core piece of the technology behind many Voice-enabled startups.
Investable Themes in Machine Learning
Now that you understand (or know, recall the difference above) the three key applications of Machine Learning, let’s apply this knowledge to early-stage venture investing.
Below we map these Machine Learning Themes to Representative Startups.
- Text: we have exceptional startups like HyperScience — enabling intelligent automation of manual document processing — and Grammarly — enabling real-time grammar correction and language (sentence structure) predictions.
- Vision, we have later-stage companies like SenseTime — providing cutting-edge computer vision packaged in a SaaS model — complementing seed-stage startups like understand.ai — providing robust training data for autonomous / self-driving vehicle companies like Google’s Waymo.
- Voice: with Amazon’s voice-only Alexa Fund providing the jet fuel for many startups like Aspinity — delivering ultra lower power neuromorphic devices — and Comet ML –a cloud-based machine learning collaboration platform for researchers — and Embodied — producing a novel voice-driven education platform for children.
Red Flags during Founder Meetings
Armed with the understanding of the realistic applications of Machine Learning and the practical investable themes (Text, Vision, and Voice), you’re now ready to evaluate the mountain of Tech startups that are claiming they’re “AI / ML-enabled.”
My approach to deal screening is a technique borrowed from Greek Stoicism.
By subtracting what we don’t know from something, we can actually progress much faster to gaining a true understanding of what that something claims itself to be.
Let’s apply that to Venture Capital deal screening of startups in Machine Learning.
Here are my Red Flags during your meetings with Founders.
- One of the Co-Founders doesn’t have a technical educational background in STEM. Machine Learning is very hard to “pick up” — unless you’re are a genius, it is something you have to absorb during your formative college years of learning.
- Founders who drink their own Kool-Aid with a poor grasp of reality.
- The presentation contains frequent use of buzzwords like “Artificial Intelligence”, “AI-powered”, “Machine Learning enabled”, and variations of these words.
- Founders (namely the CTO) who are purely focused on scientific research and have not thought about how to commercialize their machine learning technology.
- Founders who don’t understand the limitations of Machine Learning. For example, claiming that Machine Learning can write patent applications based on an analysis of prior patents is complete nonsense with current ML research.
- Founders with low exit barriers or downside risk, namely Founders with high-net-worth or with little equity in the company.
- Any pitch that claims they have achieved Artificial General Intelligence or AGI — this is the holy grail. If they did discover AGI, they wouldn’t be talking with you — they would be using their AGI to make a lot of money in the financial markets.
Returning to the original quote from Pamela McCorduck.
Artificial Intelligence, and Machine Learning, is the natural evolution of humanity’s desire to “forge the Gods”, and as such, there will be untold fortunes made from those exceptional Founders and Investors who truly understand Machine Learning, so it may be worth your time to learn it.
By Andrew Vo, CFA
Investor at Radna Intellectual Ventures
About Radna Intellectual Ventures
Radna Intellectual Ventures is a venture startup studio with a mission to enable the next generation of Deep Technologies or Deep Tech companies, with a focus on Machine Learning, Natural Language Processing, and Blockchain technologies.
Our General Partner, Andrew Vo, spent a decade in finance, working at some of the largest investment managers like J.P. Morgan, before pursuing the entrepreneurial path. Andrew serves as an Advisor for startup companies focusing on the FinTech and DeepTech sectors. Andrew is a CFA Charterholder and holds a Masters of Science in Computer Engineering from Cornell University, and a Bachelors of Science in Electrical Engineering and Computer Science from the University of California, Berkeley.
Learn more about Radna Intellectual Ventures here.
— Published on May 22, 2020