How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."

These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

From Your Site Articles

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100

Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

West Coast innovation organization unveils new location in Houston suburb to boost Texas tech ecosystem

plugging in

Leading innovation platform Plug and Play announced the opening of its new flagship Houston-area location in Sugar Land, which is its fourth location in Texas.

Plug and Play has accelerated over 2,700 startups globally last year with corporate partners that include Dell Technologies, Daikin, Microsoft, LG Chem, Shell, and Mercedes. The company’s portfolio includes PayPal, Dropbox, LendingClub, and Course Hero, with 8 percent of the portfolio valued at over $100 million.

The deal, which facilitated by the Sugar Land Office of Economic Development and Tourism, will bring a new office for the organization to Sugar Land Town Square with leasing and hiring between December and January. The official launch is slated for the first quarter of 2025, and will feature 15 startups announced on Selection Day.

"By expanding to Sugar Land, we’re creating a space where startups can access resources, build partnerships, and scale rapidly,” VP Growth Strategy at Plug and Play Sherif Saadawi says in a news release. “This location will help fuel Texas' innovation ecosystem, providing entrepreneurs with the tools and networks they need to drive real-world impact and contribute to the state’s technological and economic growth."

Plug and Play plans to hire four full-time equivalent employees and accelerate two startup batches per year. The focus will be on “smart cities,” which include energy, health, transportation, and mobility sectors. One Sugar Land City representative will serve as a board member.

“We are excited to welcome Plug and Play to Sugar Land,” Mayor of Sugar Land Joe Zimmerma adds. “This investment will help us connect with corporate contacts and experts in startups and businesses that would take us many years to reach on our own. It allows us to create a presence, attract investments and jobs to the city, and hopefully become a base of operations for some of these high-growth companies.”

The organization originally entered the Houston market in 2019 and now has locations in Bryan/College Station, Frisco, and Cedar Park in Texas.

Uniquely Houston event to convene innovation experts across aerospace, energy, and medicine

guest column

Every year, Houston's legacy industries — energy, medicine, and aerospace — come together to share innovative ideas and collaborate on future opportunities.

For the eighteenth year in a row, the annual Pumps & Pipes event will showcase and explore convergence innovation and common technology themes across Houston’s three major industries. The hosting organization, also called Pumps & Pipes, was established in 2007 in Houston and is dedicated to fostering collaboration amongst the city's three major industries.

With NASA in its backyard, the world’s largest medical center, and a reputation as the “Energy Capital of the World,” Houston is uniquely positioned to lead in cross-industry convergence innovation and is reflected in the theme of this year’s event – Blueprint Houston: Converge and Innovate.

Here's what you can expect to explore at the event, which will take place this year on December 9 at TMC Helix Park. Tickets are available online.

The state of Texas’ aerospace investments

How are the recent strategic investments in aerospace by the State of Texas transforming the space economy and driving growth in adjacent industries? What is the case for cultivating a more dynamic and vibrant aerospace R&D environment?

These are the key questions explored in the opening session of Pumps & Pipes, moderated by David Alexander (Director, Rice Space Institute). Joining the discussion are distinguished leaders Norman Garza, Jr., Executive Director of the Texas Space Commission (TSC); as well as two members of the TSC board of directors: Sarah “Sassie” Duggelby, CEO/Co-Founder of Venus Aerospace; and Kathryn Lueders, GM at Starbase, SpaceX.

This panel will spotlight Texas’ critical role in shaping the future of aerospace, with a focus on its cross-sector impact, from space exploration to innovation in energy and health care. We’ll explore how the state’s investments are fueling research and development, creating economic opportunities, and fostering a more interconnected, high-tech ecosystem for the future.

Real-world applications of robotics and synthetic biology

Explore the groundbreaking intersection of syntheticbiology and robotics as they reshape industries from aerospace to energy to health care. Experts from academia and industry — Rob Ambrose of Texas A&M University, Shankar Nadarajah of ExxonMobil, Shalini Yadav of the Rice Synthetic Biology Institute, and Moji Karimi of Cemvita — will discuss the real-world applications and future possibilities of these two fields, including innovative uses of robotics and drones to monitor emissions from deep-sea oil rigs, and synthetic microbes that convert carbon dioxide into valuable chemical products.

Discover how synthetic biology and robotics are paving the way for a more sustainable, autonomous, efficient, and interconnected future.

The total artificial heart – a uniquely Houston story

Heart failure affects millions globally, yet only a small fraction of patients receive life-saving heart transplants. The Total Artificial Heart (TAH), developed by BiVACOR, offers a revolutionary solution for patients with severe heart failure who are ineligible for a transplant.

Luminary leader, Dr. Billy Cohn, will discuss the groundbreaking BiVACOR TAH, a device that fully replaces the function of the heart using a magnetically levitated rotary pump. This innovative approach is part of an FDA-approved first-in-human study, aiming to evaluate its use as a bridge-to-transplant for patients awaiting heart transplants.

Moderated by Dr. Alan Lumsden (Chair Dept. of CV Surgery at Houston Methodist Hospital), join Dr. Cohn as he shares insights, and the story-behind, this pioneering technology and its potential to reshape the future of heart failure treatment, offering new hope to thousands of patients in need.

------

Stuart Corr is the director of Innovation Systems Engineering at Houston Methodist and executive director of Pumps & Pipes.

Houston schools shine on annual ranking of top institutions for 2025

best in class

Several Houston elementary and middle schools are at the top of the class when it comes to educating and preparing the next generation for a successful life and career, according to U.S. News & World Report's just-released list of 2025 Elementary and Middle Schools Rankings.

One such school – T.H. Rogers School in Houston ISD – is the No. 8 best middle school in Texas for 2025.

U.S. News ranked over 79,000 public schools on the state and district level using data from the U.S. Department of Education. Schools were analyzed based on their students' proficiencies in mathematics and reading/language arts on state assessments, and tie-breakers were decided based on student-teacher ratios.

Texas' best middle schools for 2025

Three Houston middle schools achieved spots among the top 10 best Texas middle schools for 2025, according to U.S. News.

T.H. Rogers School has a total enrollment of 1,063 students, with 87 percent of the student population scoring "at or above the proficient level" in mathematics, and 90 percent proficiency in reading. The school has a student-teacher ratio of 17:1, with 62 full-time teachers.

T.H. Rogers School also topped the district-wide list as the No. 1 best middle school in HISD.

Houston Gateway Academy - Coral Campus also ranked among the statewide top 10, coming in at No. 9 with a total enrollment of 914 students. U.S. News says 82 percent of HGA students are proficient in math, and 80 percent are proficient in reading.

"Houston Gateway Academy - Coral Campus did better in math and better in reading in this metric compared with students across the state," U.S. News said in the school's profile. "In Texas, 51 percent of students tested at or above the proficient level for reading, and 41 percent tested at or above that level for math."

Right behind HGA to round out the top 10 best Texas middle schools is Houston ISD's Briarmeadow Charter School. This middle school has 600 students, 69 percent of which are proficient in math and 74 percent are proficient reading.

Briarmeadow's student-teacher ratio is 16:1, which is better than the district-wide student-teacher ratio, and it employs 38 full-time teachers.

U.S. News also ranked Briarmeadow as the second best middle school in Houston ISD.

Six additional Houston-area schools ranked among the top 25 best middle schools in Texas, including:

No. 18 – Cornerstone Academy, Spring Branch ISD
No. 19 – Mandarin Immersion Magnet School, Houston ISD
No. 21 – Smith Middle School, Cypress-Fairbanks ISD
No. 22 – Seven Lakes Junior High, Katy ISD
No. 23 – Houston Gateway Academy
No. 25 – Beckendorff Junior High, Katy ISD

The best elementary schools in Texas
Jesus A. Kawas Elementary school in Laredo was crowned the No. 1 elementary school in Texas for 2025, while two Houston-area schools made it into the top 10.Tomball ISD's Creekside Forest Elementary in The Woodlands is the No. 7 best elementary school statewide, boasting 656 students, 42 full-time teachers, and one full-time counselor. Students at this school, which U.S. News designates is situated in a "fringe rural setting," scored 90 percent efficiency in math and 94 percent efficiency in reading.Following one spot behind Creekside Forest in the statewide ranking is Sugar Land's Commonwealth Elementary School in Fort Bend ISD, coming in at No. 8. Commonwealth has a student population of 954 with 55 full-time teachers, and two full-time counselors. The school's student-teacher ratio is 17:1, and 90 percent of students are proficient in math, and 94 percent in reading.U.S. News says student success at Commonwealth is significantly higher than the rest of Fort Bend ISD."In Fort Bend Independent School District, 59 percent of students tested at or above the proficient level for reading, and 47 percent tested at or above that level for math," U.S. News said in Commonwealth's profile. "Commonwealth Elementary [also] did better in math and better in reading in this metric compared with students across the state."Other Houston-area schools that were ranked among the 25 best in Texas are:

No. 13 – Bess Campbell Elementary, Sugar Land, Lamar CISD
No. 20 – West University Elementary, Houston ISD
No. 23 – T.H. Rogers School, Houston ISD
No. 25 – Griffin Elementary, Katy ISD

"The 2025 Best Elementary and Middle Schools rankings offer parents a way to evaluate how schools are providing a high-quality education and preparing students for future success," said LaMont Jones, Ed.D., the managing editor for Education at U.S. News. "The data empowers families and communities to advocate for their children’s education. Research continues to indicate that how students perform academically at these early grade levels is a big factor in their success in high school and beyond."