How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

From Your Site Articles
ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

Houston founder on shaping the future of medicine through biotechnology and resilience

Guest Column

Living with chronic disease has shaped my life in profound ways. My journey began in 5th grade when I was diagnosed with Scheuermann’s disease, a degenerative disc condition that kept me sidelined for an entire year. Later, I was diagnosed with hereditary neuropathy with liability to pressure palsies (HNPP), a condition that significantly impacts nerve recovery. These experiences didn’t just challenge me physically, they reshaped my perspective on healthcare — and ultimately set me on my path to entrepreneurship. What started as personal health struggles evolved into a mission to transform patient care through innovative biotechnology.

A defining part of living with these conditions was the diagnostic process. I underwent nerve tests that involved electrical shocks to my hands and arms — without anesthesia — to measure nerve activity. The pain was intense, and each test left me thinking: There has to be a better way. Even in those difficult moments, I found myself thinking about how to improve the tools and processes used in healthcare.

HNPP, in particular, has been a frustrating condition. For most people, sleeping on an arm might cause temporary numbness that disappears in an hour. For me, that same numbness can last six months. Even more debilitating is the loss of strength and fine motor skills. Living with this reality forced me to take an active role in understanding my health and seeking solutions, a mindset that would later shape my approach to leadership.

Growing up in Houston, I was surrounded by innovation. My grandfather, a pioneering urologist, was among the first to introduce kidney dialysis in the city in the 1950s. His dedication to advancing patient care initially inspired me to pursue medicine. Though my path eventually led me to healthcare administration and eventually biotech, his influence instilled in me a lifelong commitment to medicine and making a difference.

Houston’s thriving medical and entrepreneurial ecosystems played a critical role in my journey. The city’s culture of innovation and collaboration provided opportunities to explore solutions to unmet medical needs. When I transitioned from healthcare administration to founding biotech companies, I drew on the same resilience I had developed while managing my own health challenges.

My experience with chronic disease also shaped my leadership philosophy. Rather than accepting diagnoses passively, I took a proactive approach questioning assumptions, collaborating with experts, and seeking new solutions. These same principles now guide decision-making at FibroBiologics, where we are committed to developing groundbreaking therapies that go beyond symptom management to address the root causes of disease.

The resilience I built through my health struggles has been invaluable in navigating business challenges. While my early career in healthcare administration provided industry insights, launching and leading companies required the same determination I had relied on in my personal health journey.

I believe the future of healthcare lies in curative treatments, not just symptom management. Fibroblast cells hold the promise of engaging the body’s own healing processes — the most powerful cure for chronic diseases. Cell therapy represents both a scientific breakthrough and a significant business opportunity, one that has the potential to improve patient outcomes while reducing long-term healthcare costs.

Innovation in medicine isn’t just about technology; it’s about reimagining what’s possible. The future of healthcare is being written today. At FibroBiologics, our mission is driven by more than just financial success. We are focused on making a meaningful impact on patients’ lives, and this purpose-driven approach helps attract talent, engage stakeholders, and differentiate in the marketplace. Aligning business goals with patient needs isn’t just the right thing to do, it’s a powerful model for sustainable growth and lasting innovation in biotech.

---

Pete O’Heeron is the CEO and founder of FibroBiologics, a Houston-based regenerative medicine company.


Houston researchers make headway on affordable, sustainable sodium-ion battery

Energy Solutions

A new study by researchers from Rice University’s Department of Materials Science and NanoEngineering, Baylor University and the Indian Institute of Science Education and Research Thiruvananthapuram has introduced a solution that could help develop more affordable and sustainable sodium-ion batteries.

The findings were recently published in the journal Advanced Functional Materials.

The team worked with tiny cone- and disc-shaped carbon materials from oil and gas industry byproducts with a pure graphitic structure. The forms allow for more efficient energy storage with larger sodium and potassium ions, which is a challenge for anodes in battery research. Sodium and potassium are more widely available and cheaper than lithium.

“For years, we’ve known that sodium and potassium are attractive alternatives to lithium,” Pulickel Ajayan, the Benjamin M. and Mary Greenwood Anderson Professor of Engineering at Rice, said in a news release. “But the challenge has always been finding carbon-based anode materials that can store these larger ions efficiently.”

Lithium-ion batteries traditionally rely on graphite as an anode material. However, traditional graphite structures cannot efficiently store sodium or potassium energy, since the atoms are too big and interactions become too complex to slide in and out of graphite’s layers. The cone and disc structures “offer curvature and spacing that welcome sodium and potassium ions without the need for chemical doping (the process of intentionally adding small amounts of specific atoms or molecules to change its properties) or other artificial modifications,” according to the study.

“This is one of the first clear demonstrations of sodium-ion intercalation in pure graphitic materials with such stability,” Atin Pramanik, first author of the study and a postdoctoral associate in Ajayan’s lab, said in the release. “It challenges the belief that pure graphite can’t work with sodium.”

In lab tests, the carbon cones and discs stored about 230 milliamp-hours of charge per gram (mAh/g) by using sodium ions. They still held 151 mAh/g even after 2,000 fast charging cycles. They also worked with potassium-ion batteries.

“We believe this discovery opens up a new design space for battery anodes,” Ajayan added in the release. “Instead of changing the chemistry, we’re changing the shape, and that’s proving to be just as interesting.”

---

This story originally appeared on EnergyCapitalHTX.com.

FAA demands investigation into SpaceX's out-of-control Starship flight

Out of this world

The Federal Aviation Administration is demanding an accident investigation into the out-of-control Starship flight by SpaceX on May 27.

Tuesday's test flight from Texas lasted longer than the previous two failed demos of the world's biggest and most powerful rocket, which ended in flames over the Atlantic. The latest spacecraft made it halfway around the world to the Indian Ocean, but not before going into a spin and breaking apart.

The FAA said Friday that no injuries or public damage were reported.

The first-stage booster — recycled from an earlier flight — also burst apart while descending over the Gulf of Mexico. But that was the result of deliberately extreme testing approved by the FAA in advance.

All wreckage from both sections of the 403-foot (123-meter) rocket came down within the designated hazard zones, according to the FAA.

The FAA will oversee SpaceX's investigation, which is required before another Starship can launch.

CEO Elon Musk said he wants to pick up the pace of Starship test flights, with the ultimate goal of launching them to Mars. NASA needs Starship as the means of landing astronauts on the moon in the next few years.

View All Listings