How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

7+ can't-miss Houston business and innovation events in June 2026

where to be

Editor's note: The FIFA World Cup comes to Houston this month, joined by major energy conferences and a lineup of fan-favorite, recurring events. Here’s what not to miss and how to register. Please note: this article may be updated to add more events.


June 1-4 — CLEANPOWER 2026 Conference and Exhibition

CLEANPOWER unites policymakers, experts, and corporate leaders to solve the challenges that none can solve alone. This must-attend, four-day conference is packed with cutting-edge discussions about wind, solar, storage, and transmission; dealmaking; networking; and fun.

This event begins June 1 at the George R. Brown Convention Center. Register here.

June 2 — Humans of Healthcare

Houston Methodist Center for Innovation will present its quarterly speaker series, Humans of Healthcare. The series will feature a panel of experts who will share about their career paths and discuss the nuances of the health care industry. This month's session will focus on today’s nursing landscape, the industry’s expectations of nurses and what career paths are possible in the field.

The event is Tuesday, June 2, from 5-6:30 p.m. at the Ion. Register here.

June 9 — Greentown Go Make Kickoff

Head to the Ion to celebrate the Greentown Go Make 2026 cohort. The open-innovation program with Shell Catalysts & Technologies and Technip Energies focuses on catalytic solutions for industrial decarbonization and the energy transition. Hear pitches from the founders and network with a select group of startups while enjoying food and drink.

This event is Tuesday, June 9, from 5:30-8 p.m. Register here.

June 9-10 — Texas Brain Economy Summit

The Center for Houston’s Future and UTMB are bringing the Texas Brain Economy Summit back to Houston this summer to continue to position the region as a global leader in brain health. Expect to hear from leaders of global institutions, including the World Economic Forum, U.S. Chamber of Commerce, McKinsey Health Institute, Global Brain Economy Initiative, Davos Alzheimer’s Collaborative, Business Collaborative for Brain Health (UsAgainstAlzheimer’s), Rice University, Memorial Hermann, MD Anderson and many others. Read InnovationMap's full preview of the event here.

This event begins Tuesday, June 9. Purchase tickets here.

June 10 — MIT Future of Healthcare Technology Forum

The MIT Club of South Texas will host an in-person forum to explore how innovation, government and policy are changing the healthcare industry. The event will feature MIT alumni and Houston healthcare leaders, including Dr. Tim Boone, dean of the Texas A&M School of Engineering Medicine; Cynthia Reinhart-King, chair of bioengineering at Rice University; Dr. Tony Lin, CEO and chairman emeritus of Kelsey-Seybold Clinic; and others.

This event is Wednesday, June 10, from 5:15-8:30 p.m. at the TAMU EnMed Building. Register here.

June 11 — Goals & Gigawatts: Houston Energy & Climate Week The Power of & Kickoff Party

Come watch the Mexico City FIFA opening match while celebrating energy and innovation at the Goals & Gigawatts Kickoff Party. The event will feature food, drinks, and a showcase on Houston Energy & Climate Week. Learn what to expect and how to get involved in HECW before closing the night with a DJ and karaoke.

This event is Thursday, June 11, from 1:30-6:30 p.m. Find more information here.

June 16-17 — Energy Projects Conference & Expo

The Energy Projects Conference & Expo (EPC Show) is the largest event in North America for professionals working at the heart of major energy projects. The essential event for engineering, construction, commissioning, operations and maintenance across multiple energy sectors brings together five leading conferences under one roof. Conference subjects span LNG exporting, hydrogen and ammonia, midstream, petrochem and refining, and sustainable aviation fuels.

This event begins June 16 at George R. Brown Convention Center. Register here.

June 25 – NASA Tech Talk

Every fourth Thursday of the month, NASA experts, including longtime engineer Montgomery Goforth, present on technology development challenges NASA’s Johnson Space Center and the larger aerospace community are facing, and how they can be leveraged by Houston’s innovation community. Stick around after for drinks and networking at Second Draught.

This event is Thursday, June 25, from 6-7 p.m. at the Ion. Register here.

Houston researchers report promising first in-human trial for implantable cancer therapy

cancer breakthrough

When it comes to cancer remedies, the treatment can be as challenging for the body as its cause. But what if immunotherapy could be localized? That’s precisely what a Houston team may soon make a reality.

Rice University researchers, in partnership with MD Anderson Cancer Center, recently published their findings from the first in-human trial of an implantable cancer-fighting treatment in the journal Clinical Cancer Research. The paper details testing of AVB-001, encapsulated cells engineered to release interleukin-2 (IL-2)—a naturally occurring signaling protein that boosts immunity—in the peritoneal cavities of 14 patients. The goal is to avoid the toxicity usually experienced with less targeted treatments, as well as find a solution to IL-2s’ abbreviated half-lives.

“Traditional IL-2 therapy has shown potent antitumor activity, but its clinical use has been limited by severe side effects and delivery challenges,” Omid Veiseh, director of the Rice Biotech Launch Pad, professor of bioengineering at Rice and a senior author on the study, said in a press release. “This platform allows us to localize and sustain cytokine exposure directly where tumors reside while minimizing systemic toxicity.”

Serous ovarian carcinoma is especially well-suited to the use of AVB-001 because it tends to spread throughout the abdomen. After a minimally invasive laparoscopic procedure, patients implanted with the cells were noted to tolerate the treatment well. Half of the enrolled patients’ cancer was stabilized, with several among them reporting extended signs of benefit. No maximum tolerated dose was reached and there were no life-threatening events tied to the study.

If that sounds like less-than-earth-shaking results, this is only the beginning. The capsules were implanted for about one week because IL-2 activity drops off after that. The researchers now know that further testing should include either higher levels, repeated doses, or a combination thereof, in order to create stronger advances.

The team has already made early headway on this next step. Preclinical studies in nonhuman primates were not only tolerated well, but without added toxicity, the apes had consistent pharmacological effects.

“This is a foundational step,” Veiseh explained. “We now have evidence that the platform is safe, biologically active and potentially scalable. The next phase is optimizing dosing and exploring combination therapies to unlock its full clinical potential.”

The combination would also include a checkpoint inhibitor, which might improve AVB-001’s tumor-fighting power. “What is exciting is that we are not just delivering a drug, we are programming a microenvironment,” added Dr. Amir Jazaeri, professor of gynecologic oncology at MD Anderson, member of the Rice Biotech Launch Pad’s clinical advisory board and a senior author on the study. “This opens the door to combination strategies that could amplify immune responses in ways that have not been feasible before.”