How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."

These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

From Your Site Articles

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100

Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

Here’s where wages grew the most in Houston since 2021, according to new report

pay raise

Bolstered by a thriving manufacturing sector, Waller County—the country’s second-fastest-growing county—leads all Houston-area counties for the growth of pay from 2021 to 2026, according to a new study.

The study, conducted by personal finance website SmartAsset, found average pay in Waller County rose 48 percent from 2021 to 2026. The county’s average weekly pay climbed from $891 to $1,323 during that period.

Manufacturing ranks as the No. 1 employment sector in Waller County, accounting for about 4,500 workers, according to Executive Pulse. Those workers earn an average pay of $77,442 per year.

Waller County powers up its manufacturing hub

Waller County’s manufacturing economy keeps expanding, almost certainly contributing to the 48 percent spike in average pay from 2021 to 2026.

Grundfos, the world’s largest producer of water pumps, broke ground in June on a manufacturing plant at its Brookshire campus. The Danish company’s U.S. headquarters is in Brookshire. In conjunction with the groundbreaking, Grundfos opened the Grundfos Academy Americas training center.

The new 143,000-square-foot facility will make pump systems and water technology, primarily for water utilities and commercial real estate landlords.

Grundfos expects construction to be completed by Q3 2027, with the first production lines planned to start in Q4 of next year.

“Our growing presence in Brookshire reflects both our confidence in the U.S. market and our long‑term commitment to investing where our customers and partners need us most,” Grundfos CEO Poul Due Jensen said in a release.

Another manufacturer, TMEIC Corporation America, recently opened its third U.S. plant at Twinwood Business Park in Brookshire. The 280,000-square-foot facility, which eventually might employ 500 people, makes uninterruptible power supply units and medium-voltage power drives. The $65 million plant includes a customer training center and tech development labs.

The Twinwood facility is the largest of TMEIC’s 13 factories around the world.

TMEIC’s two other U.S. manufacturing plants are in the Houston area. The company’s North American headquarters is in the Houston Energy Corridor.

Perhaps the biggest recent manufacturing prize for Waller County: Austin-based electric vehicle maker Tesla’s new 1.65 million-square-foot factory at Brookshire’s Empire West Industrial Park. The $200 million plant, expected to employ up to 1,500 people by 2028, produces utility-scale batteries for energy storage.

Other major manufacturers in Waller County include Daikin North America and Igloo.

Pay growth around the region

Here’s a rundown of 2021-26 pay growth in the Houston metro’s eight other counties, according to SmartAsset.

Austin County — 42 percent
Chambers County — 37 percent
Harris County — 33 percent
Liberty County — 31 percent
Montgomery County — 29 percent
Fort Bend County — 28 percent
Galveston County — 26 percent
Brazoria County — 23 percent

Statewide, Dickens County, outside of Lubbock, saw the most significant growth in wages. According to the study, wages grew by 212 percent over the five years, from $707 per week in 2021 to $2,204 per week in 2026.

Among all Texas counties, Waller was ranked No. 44 on the report.

Small counties in the High Plains and West Texas regions saw the largest percent changes in average weekly wage, according to the report. See the full findings here.

Houston team’s breakthrough device leads innovation news to know

10+ can't-miss Houston business and innovation events for October

where to be

Editor's note: Healthcare and energy conferences headline this month's slate of innovation events in Houston. But there's also time for family-friendly gatherings and pickleball socials. Here’s what not to miss in October and how to register. Please note: this article may be updated to add more events.

Oct. 2 — Joy in Medicine Initiative Symposium

The Houston Methodist Joy in Medicine Initiative Symposium will explore the power of connection in enhancing professional fulfillment for clinicians and healthcare teams, this year with the theme of "Forging New Paths: Leadership, Connection & Innovation to Sustain Joy in Medicine." Hear from Dr. Shlomit Schall, Houston Methodist Physician Organization president and CEO and chief physician executive; Houston Methodist CEO Marc Boom; and Dr. Albert Wu, from Johns Hopkins, author of Therefore, Let us Rejoice: Sustaining Joy in Medicine. Stick around for a networking happy hour.

This event is Friday, Oct. 2, from 8:30 a.m.-4:30 p.m. at Thompson Houston on Allen Parkway. Find more information here.

Oct. 6-7 — Hydrogen Americas Summit and Exhibition

Hydrogen Americas delivers an unparalleled opportunity to explore how hydrogen integrates with CCUS and other energy solutions under the new U.S. and Americas energy paradigm. This event moves to Houston in 2026, providing unmatched access to industry leaders and opportunities. The summit will include CCUS-dedicated sessions integrated directly into the conference programming, providing deeper insights into carbon capture, utilization and storage. Look forward to networking opportunities to connect with global suppliers, regional developers and key policymakers.

This event begins Oct. 6 at George R. Brown Convention Center. Register here.

Oct. 6-7 — Annual Energy Summit — Energy, Risk, and Geopolitics

The 10th annual energy summit is co-hosted by Baker Botts and the Center for Energy Studies at Rice University's Baker Institute. This year's summit, “Energy, Risk, and Geopolitics,” will explore how a changing geopolitical landscape and shifts in supply chain risks are impacting investment, innovation and market dynamics. The two-day program will include discussions spanning petroleum and LNG markets, critical minerals, electricity reliability, AI and power demand.

This event begins Oct. 6 at 7:30 am at James A Baker III Hall. The event will also be livestreamed. Register here.

Oct. 7 – Rockets Get You to Orbit. Culture Gets You to Stay

The Ion will host a morning discussion exploring humanity’s future in space. The event will feature Rick Tumlinson, author of Why Space? The Purpose of People; Scott Solomon, author of Becoming Martian; and David Alexander and Alexander Regier of Rice University’s new Space Humanities Initiative. The conversations will be moderated by EarthLight Foundation Director Junaid Mian.

This event is Wednesday, Oct. 7, from 8:30-11 a.m. at the Ion. Register here.

Oct. 8 — Greentown Labs’ Fall Pickleball Social

Greentown Labs hosts its fall social at Pickle Lab HTX this month. Enjoy friendly matches, networking and light bites. All skill sets are welcome.

This event is Thursday, Oct. 8, from 5:30-7:30 p.m. at Pickle Lab HTX. Register here.

Oct. 10 – Ion Family Tech Festival

Bring the whole family out to the second Ion Family Tech Festival. Kids will get to participate in hands-on STEAM workshops and learn more about STEAM-related careers.

This event is Saturday, Oct. 10, from 9 a.m.-12 p.m. at the Ion. Register here.

Oct. 13 – Mercury Fund Day at the Ion

Don’t miss the latest installment of Mercury Fund Day at the Ion, previously known as Software Day. The recurring monthly event features office hours (by application), a keynote and networking opportunities.

This event is Tuesday, Oct. 13, from 3:30-7 p.m. at the Ion. Register here.

Oct. 14 — Future of Global Energy Conference

This October, the sixth annual Future of Global Energy Conference kicks off, convening influential leaders from across energy, technology, finance and public policy who will come together to explore the forces defining the next era of global energy and Houston’s role in shaping it. Ryan Lance, Executive Chairman of ConocoPhillips and 2027 Chair of the Greater Houston Partnership’s Board of Directors, is the keynote speaker for this year’s conference, bringing a global perspective on rising demand, market volatility and Houston’s role in the next era of energy growth.

This event takes place Oct. 14 at the Marriott Marquis. Register here.

Oct. 17 — Energy Day 2026

Energy Day Houston is the nation’s largest free, family-friendly STEM festival. It features over 50 interactive exhibits and live demonstrations focused on traditional and emerging energy career paths to power up your curiosity.

This event begins at 11 a.m. on Oct. 17 at Sam Houston Park. Get details here.

Oct. 22 — Rice360 Innovation for Healthcare Access Conference

Researchers and innovators from Rice University, the Texas Medical Center, non-profit organizations, healthcare providers and others will come together to explore gaps in healthcare at the Innovation for Healthcare Access Conference. The event will feature speakers, workshops and case study presentations and will focus on innovations for the health of women and children in underserved rural and urban communities across Texas.

This event is Thursday, Oct. 22, from 8 a.m.-5 p.m. at the Rice University BioScience Research Collaborative (BRC). Register here.

Oct. 28-29 – TiECon 2026

TiE Houston, TiE Dallas and TiE Austin are joining forces to host TiEcon Texas 2026 at the Ion this month. The event will focus on how automation, artificial intelligence and emerging technologies are reshaping Texas industries, the economy and daily life. The conference will feature keynotes, panels, fireside chats and the TiE Hatch Pitch Competition.

This event starts Thursday, Oct. 29, at the Ion. Register here.

View All Listings

INNOVATIONMAP EMAILS ARE AWESOME