How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Houston space tech startups share latest updates on lunar missions and more

space update

Houston-based space tech companies Axiom Space and Intuitive Machines recently shared updates on innovative projects and missions, each set to launch by 2027.

Axiom Space

Axiom Space, developer of the world’s first commercial space station and other space infrastructure, is gearing up to launch two orbital data center nodes to low-earth orbit by the end of 2025.

The Axiom Space nodes will lay the foundation for space-based cloud computing. Axiom says orbital data centers provide cloud-enabled data storage and processing, artificial intelligence, and machine learning directly to satellites, constellations, and other spacecraft in Earth’s orbit. This innovation will reduce reliance on earth-based systems, enhance wireless mesh networks and improve real-time operation of space-borne assets, according to Axiom.

Axiom has been working on the development of orbital data centers since 2022. The two nodes going into space in 2025 will be part of Kepler Communications’ 10-satellite data relay network, which is scheduled to launch by the end of this year. Axiom Space and Kepler Communications have been collaborating since 2023.

Kam Ghaffarian, co-founder, executive chairman, and CEO of Axiom, says his company already has deals in place with buyers of space-based cloud computing services. Orbital data centers “are integral to Axiom Space’s vision of era-defining space infrastructure, unlocking transformational capabilities and economic growth,” he says.

Axiom Space says it will be able to buy additional payloads on Kepler’s network to boost capacity for orbital data centers. The two companies will team up to provide network and orbital data center services to various customers.

Intuitive Machines

Meanwhile, Intuitive Machines, a space exploration, infrastructure and services company, has picked SpaceX’s Falcon 9 rocket to launch its fourth delivery mission to the moon. The launch will include two lunar data relay satellites for NASA.

Intuitive Machines says its fourth lunar delivery mission is scheduled for 2027. The mission will comprise six NASA commercial lunar payloads, including a European Space Agency drill set designed to search for water at the moon’s south pole.

“Lunar surface delivery and data relay satellites are central to our strategy to commercialize the moon,” Intuitive Machines CEO Steve Altemus says.

The first of five lunar data relay satellites will be included in the company’s third delivery mission to the moon. The fourth mission, featuring two more satellites, will be followed by two other satellite-delivery missions.

Houston doctor aims to revolutionize hearing aid industry with tiny implant

small but mighty

“What is the future of hearing aids?” That’s the question that led to a potential revolution.

“The current hearing aid market and technology is old, and there are little incremental improvements, but really no significant, radical new ideas, and I like to challenge the status quo,” says Dr. Ron Moses, an ENT specialist and surgeon at Houston Methodist.

Moses is the creator of NanoEar, which he calls “the world’s smallest hearing aid.” NanoEar is an implantable device that combines the invisibility of a micro-sized tympanostomy tube with more power—and a superior hearing experience—than the best behind-the-ear hearing aid.

“You put the NanoEar inside of the eardrum in an in-office procedure that takes literally five minutes,” Moses says.

As Moses explains, because of how the human cochlea is formed, its nerves break down over time. It’s simply an inevitability that if we live long enough, we will need hearing aids.

“The question is, ‘Are we going to all be satisfied with what exists?’” he asks.

Moses says that currently, only about 20 percent of patients who need hearing aids have them. That’s because of the combination of the stigma, the expense, and the hassle and discomfort associated with the hearing aids currently available on the market. That leaves 80 percent untapped among a population of 466 million people with hearing impairment, and more to come as our population ages. In a nearly $7 billion global market, that additional 80 percent could mean big money.

Moses initially patented a version of the invention in 2000, but says that it took finding the right team to incorporate as NanoEar. That took place in 2016, when he joined forces with cofounders Michael Moore and Willem Vermaat, now the company’s president and CFO, respectively. Moore is a mechanical engineer, while Vermaat is a “financial guru;” both are repeat entrepreneurs in the biotech space.

Today, NanoEar has nine active patents. The company’s technical advisors include “the genius behind developing the brains in this device,” Chris Salthouse; NASA battery engineer Will West; Dutch physicist and audiologist Joris Dirckx; and Daniel Spitz, a third-generation master watchmaker and the original guitarist for the famed metal band Anthrax.

The NanoEar concept has done proof-of-concept testing on both cadavers at the University of Antwerp and on chinchillas, which are excellent models for human hearing, at Tulane University. As part of the TMC Innovation Institute program in 2017, the NanoEar team met with FDA advisors, who told them that they might be eligible for an expedited pathway to approval.

Thus far, NanoEar has raised about $900,000 to get its nine patents and perform its proof-of-concept experiments. The next step is to build the prototype, but completing it will take $2.75 million of seed funding.

Despite the potential for making global change, Moses has said it’s been challenging to raise funds for his innovation.

“We're hoping to find that group of people or person who may want to hear their children or grandchildren better. They may want to join with others and bring a team of investors to offset that risk, to move this forward, because we already have a world-class team ready to go,” he says.

To that end, NanoEar has partnered with Austin-based Capital Factory to help with their raise. “I have reached out to their entire network and am getting a lot of interest, a lot of interest,” says Moses. “But in the end, of course, we need the money.”

It will likely, quite literally, be a sound investment in the future of how we all hear the next generation.