How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Houston team develops innovative soft skeleton for kids with cerebral palsy

health tech

A team from the NSF University of Houston Building Reliable Advances and Innovation in Neurotechnology (UH BRAIN) Center and TIRR Memorial Hermann has introduced the MyoStep soft exoskeleton for children with cerebral palsy, according to a news release from UH.

The soft skeleton aims to address motor impairments caused by cerebral palsy that impact children’s ability to participate in physical activities, self-care and academics.

“The MyoStep project represents a significant advancement in the field of pediatric mobility aids, particularly for children with cerebral palsy,” Jose Luis Contreras-Vidal, director of UH BRAIN and the Hugh Roy and Lillie Cranz Cullen Distinguished Professor of Electrical and Computer Engineering, said in a news release.

The next-generation lightweight, soft exoskeleton was funded by the IEEE Electron Devices Society (EDS) Award.

The MyoStep is made to be lightweight and discreetly fit under clothes. It includes a wireless sensor network embedded inside the smart and flexible fabrics that is the backbone of the suit and collects and sends real-time data about the user’s movements It also includes safety features with temperature monitoring and emergency shut-off mechanisms.

“By integrating cutting-edge technologies such as artificial muscles, smart fabrics, and a comprehensive sensor network, MyoStep offers a promising solution to the challenges faced by existing exoskeletons,” Contreras-Vidal said in a news release.

Cerebral palsy is a neurological disorder that impacts motor skills. It occurs in one to four out of every 1,000 births worldwide.

“What makes the MyoStep project so compelling is that it’s not just about the technology: it’s about restoring confidence, function, and hope,” Dr. Gerard Francisco, a clinical partner on the technology, The Wulfe Family Chair of Physical Medicine and Rehabilitation at UTHealth Houston and medical officer at TIRR Memorial Hermann, said in a news release. “This kind of innovation has the potential to dramatically improve quality of life, helping children move through the world with greater ease and dignity.”

Houston universities launch summer 2025 accelerators for student ventures

summer session

OwlSpark, a startup and small business accelerator for Rice University-affiliated ventures, has named the latest 11 companies to its program that focus on challenges across technology, health care, consumer products and other sectors. The program is hosted in tandem with the University of Houston’s RED Labs and will take place at the Ion.

The early-stage accelerator runs for 12 weeks and culminates at The Bayou Startup Showcase on July 31.

According to a news release from Rice, “the accelerator cultivates a vibrant environment where founders are empowered to build, test, and scale their ideas in a setting built for entrepreneurship.”

The program is divided into two tracks: one for high-growth tech startups and another for small businesses.

The latest OwlSpark class includes:

  • Web and mobile platform EasilyBEE, which boosts family and community engagement in K-12 schools
  • Diagnos, a wearable-integrated wellness platform that monitors health and prevents injuries in college athletes
  • Johnnie, an AI-powered records management software for rural and midsize first responder agencies
  • JustKindHumility, which offers faith-based travel journals
  • Klix, whichautomates early-stage clinical trial management from document screening to AI-driven patient outreach and eligibility checks
  • Lizzy’s Gourmet Gains, which offers high-protein, flavor-forward dips and dressings
  • NextStep, an AI-powered multilingual assistant helping underserved communities navigate resources for health care
  • A catheter-integrated sensor device PeriShield, which detects early infection in peritoneal dialysis patients
  • Right Design, which connects creatives with vetted employers, mentors and projects via job matching and commissions
  • UCoreAlly, which provides business support for biotech startups in marketing, business development, customer support, human resources and accounting
  • Ultrasound-based ablation system VentriTech that treats ventricular arrhythmias

The Owl Spark accelerator has supported 229 founders and launched 104 ventures with participants raising more than $116 million in funding since 2013, according to Rice.

UH also shared the 9 teams that will participate in RED Labs' latest cohort.

The latest RED Labs class includes:

  • BLEED, an art agency that helps artists commercialize their work by connecting art collectors to original artwork and artists
  • Brain Haven, which is developing nasal inhalers designed to stimulate the emotional and memory processing centers to preserve neuroplasticity and delay cognitive decline
  • Candi Wands Automated Cotton Candy, which has developed a continuously operating cotton candy machine to help entertainment venues boost passive revenue
  • ChériCollectible, a series of in-person events where Gen Z and collectors can buy, sell, and trade modern collectibles
  • JobRadar, a job board that uses AI to analyze and categorize positions in real-time and then apply candidates instantly
  • Stage Select LLC, a supplementary talent booking service that partners with multi-stage venues to help fill gaps in programming and increase profitability by finding and booking local talent for their "second stage."
  • P-LEGS, a pediatric lower-limb exoskeleton that reduces physical strain on therapists while delivering customizable gait training.
  • Roll ‘N’ Reel Photo Booth, an interactive event-based equipment rental business
  • Stayzy, which automates guest communication and handles maintenance issues with an AI-powered software for short-term rental companies that manage 20-plus rentals