How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

From Your Site Articles
ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

UH lands $4M NIH grant to study early signs of autoimmune disease

NIH funding

The University of Houston recently received a $4 million National Institutes of Health grant to support a 10-year longitudinal study to identify the earliest biological markers of autoimmune disease.

Led by Chandra Mohan, the Hugh Roy and Lillie Cranz Cullen Endowed Professor of Biomedical Engineering, the study aims to examine what causes Systemic Autoimmune Rheumatic Diseases (SARDs) and to identify targets for future treatments. The study will be carried out in collaboration with Dr. Karen Costenbader at Harvard Medical School, Boston.

SARDs include conditions like rheumatoid arthritis, systemic lupus erythematosus, Sjögren’s syndrome and systemic sclerosis—all are considered chronic diseases currently without a cure. Autoimmune diseases affect over 30 million people globally, according to UH.

SARDs occur when the body’s immune system attacks healthy, non-threatening tissues and organs. According to UH, in these diseases, the body often attacks nuclear antigens, creating anti-nuclear autoantibodies, which can be early detection signs for SARDs in more than 50 percent of patients, Mohan says.

Researchers will study blood samples and environmental exposure over the 10 years to better understand anti-nuclear autoantibodies.

“Collectively, these studies will help identify the genetic, environmental and cellular factors that are operative at the two steps of SARD development, namely the emergence of anti-nuclear autoantibodies and disease onset,” Mohan said in a news release. “ More importantly, these studies will highlight functional molecular pathways and mechanisms that may be operative at each step."

Mohan predicts that looking at SARDs’ shared characteristics, rather than each disease individually, could help identify more treatment methods.

“Individual SARDs have been examined in silos without an attempt to discern shared underlying features at the molecular level,” he added in the release. “Current understanding of the initial (and likely shared) origins of SARDs is only rudimentary but urgently needed to develop means for prevention and treatment.”

Earlier this year, UH also received an $11 million NIH grant to conduct a first-of-its-kind study of early language development in children ages 18 to 24 months. Read more here.

New Texas Stock Exchange officially begins trading in Dallas

Welcome to Y'all Street

Two-step aside, New York Stock Exchange and Nasdaq. The Dallas-based Texas Stock Exchange, nicknamed Y’all Street, just kicked off live trading with five stocks — and lots of Lone Star ambition.

“The Texas Stock Exchange aims to revitalize competition for [stock] issuers, establish the premier venue for listings, and create a world-class trading platform for all market participants,” the exchange says in a fact sheet.

The exchange — whose Texas-influenced nickname is a nod to New York City’s Wall Street — has collected at least $275 million in investments. The roughly 90 financial backers of TXSE include Bank of America, BlackRock, Charles Schwab, Citadel Securities, Dell Family Office, Fortress, Goldman Sachs, and JPMorgan Chase.

Representatives of TXSE couldn’t be reached for comment. On its website, the exchange calls itself “the most well-capitalized equities exchange to ever be approved” by the U.S. Securities and Exchange Commission (SEC).

Not to be outdone, NYSE has launched Dallas-based NYSE Texas and Nasdaq has expanded its presence in Dallas.

Y’all Street adds to Dallas-Fort Worth’s rising status as a major hub for financial services, with The Wall Street Journal naming North Texas the country’s second biggest financial hub after New York City.

“A homegrown national exchange means more jobs, more investment, and more growth opportunities for businesses and communities across the Lone Star State,” Gabriela von zur Muehlen, senior vice president and chief policy officer at the Texas Association of Business, told The Texas Tribune.

Bulent Temel, an associate professor of practice in economics at the University of Texas at San Antonio, told Texas Standard that TXSE “is going to boost the credibility of the Texas economy.”

Texas’ estimated gross domestic product (GDP), a yardstick for the size of an economy, climbed to a record-setting $2.9 trillion in 2025, making it the state with the second highest GDP after California. DFW’s estimated GDP in 2023 stood at $744.6 billion, eclipsing the GDP of many countries.

“The center of gravity for American capitalism is now headquartered in the Boom Belt,” Abbott proclaimed in April, referring to an 11-state region (including Texas) in the South and Southeast that’s seeing tremendous economic and population growth. “The Texas Stock Exchange is the natural extension of that capitalism. It ensures that capital markets will reflect the quadrant that is driving American growth.”

---

This article originally appeared on CultureMap.com.

Orion vehicle manager reflects on Artemis II, looks to 2028 moon mission

Q&A

Humanity is finally headed back to the moon after more than half a century. This year's launch of the Artemis II mission in the Orion spacecraft put four crew members in lunar orbit and tested the new ship developed by Lockheed Martin.

Everything went smoothly, safely returning astronauts home, but there is always room to improve. InnovationMap chatted via email with Orion vehicle manager Branelle Rodriguez, shortly after a talk at The Ion, for insight on how Orion might perform in the future as the next lunar landing approaches in early 2028.

InnovationMap: How satisfied are you with the way Orion operated on this past mission?

Branelle Rodriguez: Orion performed exceptionally well during Artemis II, successfully demonstrating critical spacecraft capabilities, including life support systems, displays and controls, and executing manual piloting operations. Artemis II brought humans back to the moon, achieving key exploration and scientific imagery, while validating systems essential for future Artemis missions.

IM: What is the most important thing you learned about improving Orion for the next mission?

BR: The Artemis II mission provided invaluable insights into crew operations and spacecraft performance in a deep-space environment. With every mission, NASA applies lessons learned to continuously improve Orion’s operations, validate design and ensure mission readiness. Artemis II offered our first opportunity to evaluate several new systems and gain a deeper understanding of what it is like for astronauts to live and work inside the spacecraft. The operational, technical and human factors data collected are being integrated across the program to refine future missions, reduce risk and enhance overall mission success.

IM: How has Orion helped the mission to explore space?

BR: Orion is one of NASA’s foundational elements for human deep space exploration—not only supporting the mission but serving as a core component of it. It is currently the only spacecraft capable of carrying crew on deep space missions and returning them safely to Earth from the high speeds required from the vicinity of the moon. No other spacecraft has the technology to endure the extremes that come with human deep-space travel, such as advanced environmental and life support, navigation, communications, radiation shielding, and the world’s largest ablative heat shield to protect the astronauts during reentry into Earth’s atmosphere. Orion has already taken astronauts to explore space farther than ever before—252,756 miles from Earth— and will carry crews to the moon on future missions to explore the lunar South Pole region. The astronauts’ observations, samples, and data collected on these future missions will expand our understanding of our solar system and home planet.

---

This conversation has been edited for brevity and clarity.

View All Listings