How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

From Your Site Articles
ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

Baylor center receives $10M NIH grant to continue rare disease research

NIH funding

Baylor College of Medicine’s Center for Precision Medicine Models received a $10 million, five-year grant from the National Institutes of Health last month that will allow it to continue its work studying rare genetic diseases.

The Center for Precision Medicine Models creates customized cell, fly and mouse models that mimic specific genetic variations found in patients, helping scientists to better understand how genetic changes cause disease and explore potential treatments.

The center was originally funded by an NIH grant, and its models have contributed to the discovery of several new rare disease genes and new symptoms caused by known disease genes. It hosts an online portal that allows physicians, families and advocacy groups to nominate genetic variants or rare diseases that need further investigation or new treatments.

Since its founding in 2020, it has received 156 disease/variant nominations, accepted 63 for modeling and produced more than 200 precision models, according to Baylor.

The center plans to use the latest round of funding to bring together more experts in rare disease research, animal modeling and bioinformatics, and to expand its focus and model more complex diseases.

Dr. Jason Heaney, associate professor in the Department of Molecular and Human Genetics at BCM, serves as the lead principal investigator of the center.

“The Department of Molecular and Human Genetics is uniquely equipped to bring together the diverse expertise needed to connect clinical human genetics, animal research and advanced bioinformatics tools,” Heaney added in the release. “This integration allows us to drive personalized medicine forward using precision animal models and to turn those discoveries into better care for patients.”

Houston institutions launch Project Metis to position region as global leader in brain health

brain trust

Leaders in Houston's health care and innovation sectors have joined the Center for Houston’s Future to launch an initiative that aims to make the Greater Houston Area "the global leader of brain health."

The multi-year Project Metis, named after the Greek goddess of wisdom and deep thought, will be led by the newly formed Rice Brain Institute, The University of Texas Medical Branch's Moody Brain Health Institute and Memorial Hermann’s comprehensive neurology care department. The initiative comes on the heels of Texas voters overwhelmingly approving a ballot measure to launch the $3 billion, state-funded Dementia Prevention and Research Institute of Texas (DPRIT).

According to organizers, initial plans for Project Metis include:

  • Creating working teams focused on brain health across all life stages, science and medical advances, and innovation and commercialization
  • Developing a regional Brain Health Index to track progress and equity
  • Implanting pilot projects in areas such as clinical care, education and workplace wellness
  • Sharing Houston’s progress and learnings at major international forums, including Davos and the UN General Assembly

The initiative will be chaired by:

  • Founding Chair: Dr. Jochen Reiser, President of UTMB and CEO of the UTMB Health System
  • Project Chair: Amy Dittmar, Howard R. Hughes Provost and Executive Vice President of Rice University
  • Project Chair: Dr. David L. Callender, President and CEO of Memorial Hermann Health System

The leaders will work with David Gow, Center for Houston’s Future president and CEO. Gow is the founder and chairman of Gow Media, InnovationMap's parent company.

“Now is exactly the right time for Project Metis and the Houston-Galveston Region is exactly the right place,” Gow said in a news release. “Texas voters, by approving the state-funded Dementia Prevention Institute, have shown a strong commitment to brain health, as scientific advances continue daily. The initiative aims to harness the Houston’s regions unique strengths: its concentration of leading medical and academic institutions, a vibrant innovation ecosystem, and a history of entrepreneurial leadership in health and life sciences.”

Lime Rock Resources, BP and The University of Texas MD Anderson Cancer Center served as early steering members for Project Metis. HKS, Houston Methodist and the American Psychiatric Association Foundation have also supported the project.

An estimated 460,000 Texans are living with dementia, according to the Alzheimer’s Association, and more than one million caregivers support them.

“Through our work, we see both the immense human toll of brain-related illness and the tremendous potential of early intervention, coordinated care and long-term prevention," Callender added in the release. "That’s why this bold new initiative matters so much."

Texas launches cryptocurrency reserve with $5 million Bitcoin purchase

Money Talks

Texas has launched its new cryptocurrency reserve with a $5 million purchase of Bitcoin as the state continues to embrace the volatile and controversial digital currency.

The Texas Comptroller’s Office confirmed the purchase was made last month as a “placeholder investment” while the office works to contract with a cryptocurrency bank to manage its portfolio.

The purchase is one of the first of its kind by a state government, made during a year where the price of Bitcoin has exploded amid the embrace of the digital currency by President Donald Trump’s administration and the rapid expansion of crypto mines in Texas.

“The Texas Legislature passed a bold mandate to create the nation’s first Strategic Bitcoin Reserve,” acting Comptroller Kelly Hancock wrote in a statement. “Our goal for implementation is simple: build a secure reserve that strengthens the state’s balance sheet. Texas is leading the way once again, and we’re proud to do it.”

The purchase represents half of the $10 million the Legislature appropriated for the strategic reserve during this year’s legislative session, but just a sliver of the state’s $338 billion budget.

However, the purchase is still significant, making Texas the first state to fund a strategic cryptocurrency reserve. Arizona and New Hampshire have also passed laws to create similar strategic funds but have not yet purchased cryptocurrency.

Wisconsin and Michigan made pension fund investments in cryptocurrency last year.

The Comptroller’s office purchased the Bitcoin the morning of Nov. 20 when the price of a single bitcoin was $91,336, according to the Comptroller’s office. As of Friday afternoon, Bitcoin was worth slightly less than the price Texas paid, trading for $89,406.

University of Houston energy economist Ed Hirs questioned the state’s investment, pointing to Bitcoin’s volatility. That makes it a bad investment of taxpayer dollars when compared to more common investments in the stock and bond markets, he said.

“The ordinary mix [in investing] is one that goes away from volatility,” Hirs said. “The goal is to not lose to the market. Once the public decides this really has no intrinsic value, then it will be over, and taxpayers will be left holding the bag.”

The price of Bitcoin is down significantly from an all-time high of $126,080 in early October.

Lee Bratcher, president of the Texas Blockchain Council, argued the state is making a good investment because the price of Bitcoin has trended upward ever since it first launched in early 2009.

“It’s only a 16-year-old asset, so the volatility, both in the up and down direction, will smooth out over time,” Bratcher said. “We still want it to retain some of those volatility characteristics because that’s how we could see those upward moves that will benefit the state’s finances in the future.”

Bratcher said the timing of the state’s investment was shrewd because he believes it is unlikely to be valued this low again.

The investment comes at a time that the crypto industry has found a home in Texas.

Rural counties have become magnets for crypto mines ever since China banned crypto mining in 2021 and Gov. Greg Abbott declared “Texas is open for crypto business” in a post on social media.

The state is home to at least 27 Bitcoin facilities, according to the Texas Blockchain Council, making it the world’s top crypto mining spot. The two largest crypto mining facilities in the world call Texas home.

The industry has also come under criticism as it expands.

Critics point to the industry’s significant energy usage, with crypto mines in the state consuming 2,717 megawatts of power in 2023, according to the comptroller’s office. That is enough electricity to power roughly 680,000 homes.

Crypto mines use large amounts of electricity to run computers that run constantly to produce cryptocurrencies, which are decentralized digital currencies used as alternatives to government-backed traditional currencies.

A 2023 study by energy research and consulting firm Wood Mackenzie commissioned by The New York Times found that Texans’ electric bills had risen nearly 5%, or $1.8 billion per year, due to the increase in demand on the state power grid created by crypto mines.

Residents living near crypto mines have also complained that the amount of job creation promised by the facilities has not materialized and the noise of their operation is a nuisance.

“Texas should be reinvesting Texan’s tax money in things that truly bolster the economy long term, living wage, access to quality healthcare, world class public schools,” said state Sen. Molly Cook, D-Houston, who voted against the creation of the strategic fund. “Instead it feels like they’re almost gambling our money on something that is known to be really volatile and has not shown to be a tide that raises all boats.”

State Sen. Charles Schwertner, R-Georgetown, who authored the bill that created the fund, said at the time it passed that it will allow Texas to “lead and compete in the digital economy.”

___

This story was originally published by The Texas Tribune and distributed through a partnership with The Associated Press.

View All Listings