How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

New Houston-born app OpenToBites connects users over meals in 16 cities

Friends and Food

A Houston-born social is connecting foodies and social butterflies for shared meals. OpenToBites launched on Android on June 18 and iOS on June 22, and is available to use for free in Houston and beyond.

Founded and operated by Houston developer Kelvin John, OpenToBites allows users to connect over meals in 16 cosmopolitan cities. That includes Austin and Houston in Texas, plus other American cities like Denver and New York, and even international destinations including Paris, Tokyo, and Sydney.

The app is built on a simple concept, and a press release emphasizes that it's for anyone who wants "friendly company."

“We built OpenToBites in response to several trends, including the rise of solo travel and the demand for social experiences that don’t feel like dating, networking, or large organized events,” said a spokesperson in the release. “We are not a dating app. We are offering shared food and conversation for people who want simple, in-person meal company in a public setting.”

When signing up, users provide their first name, an optional profile photo, and a short bio. They mark themselves as a traveler, a local, or both, and have the option to select their age range or opt out.

Once a profile is created, the user can search for existing meals or create a meal happening within the next 72 hours. To find an existing meal to join as a guest, they select the city, date, and apply filters for the number of seats, type of cuisine, and whether they want to share food with the table or order their own.

Since someone has to get the party started, users can also take the initiative to start a meal as a host. They'll choose the date, time, and restaurant — anything is on the menu, as long as they can link to the restaurant on Google Maps or its own website.

This divides users into "host" and "guest." Guests request to join a table, and a host can decide to accept the request or not. Guests aren't able to see the exact restaurant until their request is accepted, so hosts have a "helpful note" field to fill out with more information about the restaurant.

A similar app called Timeleft launched in Austin in 2024, acting as a friendship matchmaker for small groups of strangers who answer personality questions, meet at a restaurant for dinner, and decide if they wanted to stay in touch.

Though OpenToBites has a similar concept, it seems to work more like Couchsurfing, an app that connects travelers on their own terms. OpenToBites also emphasizes the immediate over the long-term — the meal itself is the social goal.

OpenToBites is available for free on the App Store and Play Store; the app plans to grow each current city's user base before adding new locations.

---

This article originally appeared on CultureMap.com.

Houston mental health nonprofit expands platform statewide to connect more Texans with care

access granted

As mental health conversations evolve, the necessary pivot becomes how organizations across Texas navigate improved ways to help people access the care they need before their challenges become crises.

That’s why Mental Health America of Greater Houston recently announced that it is expanding its Care Connect platform statewide.

The expansion will address perhaps the most persistent barrier to behavioral healthcare—helping people find and navigate services that already exist.

Care Connect’s extended reach comes at a time when more than 3.5 million adults in the state live with some kind of mental health condition and scores of those in need continue to struggle with accessing care despite the growing awareness of mental health needs.

According to President and CEO Renae Vania Tomczak, Care Connect’s main goal was to remove as many obstacles as possible that Texans face when seeking mental health support.

“Care Connect was about a two-year planning process,” Tomczak says. “It really began with asking what challenges people in the Greater Houston Area were facing regarding mental health. It’s not just accessing care, but the difficulty in navigating the mental healthcare system.”

While provider shortages remain a challenge in some communities, Mental Health America of Greater Houston found that many individuals and families struggle simply to determine where to turn, how to identify the right provider and whether services are affordable.

“We wanted to make it easier for people who have questions, who may never have had a mental health challenge before, or they’re a caregiver for somebody who has a mental health issue,” Tomczak says. “We wanted to be the place that people can come to get their questions answered and be connected to care.”

Care Connect combines a vetted network of more than 1,000 providers and services across Texas with personalized navigation support.

Searches generate care results based on insurance coverage, language preferences, ZIP code and clinical specialties.

Additionally, one-on-one guidance and follow-up support are provided by bilingual resource specialists.

The platform also seeks to address affordability, one of the most significant barriers to mental healthcare access. Through participating providers, eligible individuals can receive six to eight counseling sessions at no cost.

“We have several providers who are willing to provide six to eight counseling sessions at no cost for people who do not have the means to pay for services themselves,” Tomczak says.

When provider matches are unavailable, the organization can connect individuals with master’s-level mental health professionals working under the supervision of licensed clinicians.

The statewide rollout builds on the platform’s early success in the Houston region, where it has helped thousands of individuals connect with mental health resources since launching last fall.

According to Tomczak, the decision to expand was driven in part by growing demand from outside the organization’s traditional service area.

“Last month we decided to take this program statewide,” she says. “It’s not just Houston that can use help in connecting to appropriate mental health services, but the whole state.”

The Care Connect program’s promotion through healthcare providers, community organizations and public-sector partners across Texas is now one of Mental Health America of Greater Houston’s top priorities.

Their goal is to create a stronger referral ecosystem that ultimately helps those who need access to mental health care more quickly.

To facilitate that, the organization has also added free mental health screenings to its website so that users will better identify any symptoms related to anxiety, depression and other conditions.

“Once they do that, then where do they go?” Tomczak says. “They’re not sure who to call and who can help them. At that point, we hope they’ll call us and talk to somebody live who can answer their questions and help them get started on the right path to improving their mental health.”

With eyes on the future, Tomczak believes public understanding of mental health has improved in recent years, particularly following the COVID-19 pandemic, which brought new attention to the effects of stress, isolation and uncertainty.

“The more we talk about it and have the opportunity to share that mental health conditions are traceable, the better,” she says.

According to Tomczak, long-term, Care Connect aims to reduce roadblocks that exist between recognizing the need for help and receiving it.

Ultimately, Care Connect hopes to create a robustly connected behavioral health system that gives Texans the ability to access mental health services swiftly and with confidence.

“No one should have to navigate mental health challenges alone,” Tomczak adds. “Care Connect is here to help connect people with resources, services and answers to ensure they get the care they need to take the next step toward better mental health.”