How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Rice University team develops eco-friendly method to destroy 'forever chemicals' in water

clean water research

Rice University researchers have teamed up with South Korean scientists to develop the first eco-friendly technology that captures and destroys toxic “forever chemicals,” or PFAS, in water.

PFAS have been linked to immune system disruption, certain cancers, liver damage and reproductive disorders. They can be found in water, soil and air, as well as in products like Teflon pans, waterproof clothing and food packaging. They do not degrade easily and are difficult to remove.

Thus far, PFAS cleanup methods have relied on adsorption, in which molecules cling to materials like activated carbon or ion-exchange resins. But these methods tend to have limited capacity, low efficiency, slow performance and can create additional waste.

The Rice-led study, published in the journal Advanced Materials, centered on a layered double hydroxide (LDH) material made from copper and aluminum that could rapidly capture PFAS and be used to destroy the chemicals.

The study was led by Rice professor Youngkun Chung, a postdoctoral fellow under the mentorship of Michael S. Wong. It was conducted in collaboration with Seoktae Kang, professor at the Korea Advanced Institute of Science and Technology, and Keon-Ham Kim, professor at Pukyung National University, who first discovered the LDH material.

The team evaluated the LDH material in river water, tap water and wastewater. And, according to Rice, that material’s unique copper-aluminum layers and charge imbalances created an ideal binding environment to capture PFAS molecules.

“To my astonishment, this LDH compound captured PFAS more than 1,000 times better than other materials,” Chung, lead author of the study and now a fellow at Rice’s WaTER (Water Technologies, Entrepreneurship and Research) Institute and Sustainability Institute, said in a news release. “It also worked incredibly fast, removing large amounts of PFAS within minutes, about 100 times faster than commercial carbon filters.”

Next, Chung, along with Rice professors Pedro Alvarez and James Tour, worked to develop an eco-friendly, sustainable method of thermally decomposing the PFAS captured on the LDH material. They heated saturated material with calcium carbonate, which eliminated more than half of the trapped PFAS without releasing toxic by-products.

The team believes the study’s results could potentially have large-scale applications in industrial cleanups and municipal water treatments.

“We are excited by the potential of this one-of-a-kind LDH-based technology to transform how PFAS-contaminated water sources are treated in the near future,” Wong added in the news release. “It’s the result of an extraordinary international collaboration and the creativity of young researchers.”

Axiom Space announces new CEO amid strategic leadership change

new leader

Six months after promoting Tejpaul Bhatia from chief revenue officer to CEO, commercial space infrastructure and human spaceflight services provider Axiom Space has replaced him.

On Oct. 15, Houston-based Axiom announced Jonathan Cirtain has succeeded Bhatia as CEO. Bhatia joined Axiom in 2021. Cirtain remains the company’s president, a role he assumed in June, according to his LinkedIn profile.

In a news release, Axiom said Cirtain’s appointment as CEO is a “strategic leadership change” aimed at advancing the company’s development of space infrastructure.

Axiom hired Cirtain as president in June, according to his LinkedIn profile. The company didn’t publicly announce that move.

Kam Ghaffarian, co-founder and executive chairman of Axiom, said Cirtain’s “proven track record of leadership and commitment to excellence align perfectly with our mission of building era-defining space infrastructure that will drive exploration and fuel the global space economy.”

Aside from praising Cirtain, Ghaffarian expressed his “sincere gratitude” for Bhatia’s work at Axiom, including his leadership as CEO during “a significant transition period.”

Bhatia was promoted to CEO in April after helping Axiom gain more than $1 billion in contracts, Space News reported. He succeeded Ghaffarian as CEO. Axiom didn’t indicate whether Bhatia quit or was terminated.

Cirtain, an astrophysicist, was a senior executive at BWX Technologies, a supplier of nuclear components and fuel, for eight years before joining Axiom. Earlier, Cirtain spent nearly nine years in various roles at NASA’s Marshall Space Flight Center in Huntsville, Alabama. He previously co-founded a machine learning company specializing in Earth observation.

“Axiom Space is pioneering the commercialization of low-Earth orbit infrastructure while accelerating advancements in human spaceflight technologies,” Cirtain said. “I look forward to continuing our team’s important work of driving innovation to support expanded access to space and off-planet capabilities that will underpin the future of space exploration.”

Among other projects, Axiom is developing the world’s first commercial space station, creating next-generation spacesuits for astronauts and sending astronauts on low-Earth orbit missions.

Houston billionaire benefactors will donate almost entire fortune to charity

Giving Back

Houston billionaires Rich and Nancy Kinder plan to donate an astounding 95% of their multi-billion-dollar wealth to charities, they told ABC13's Melanie Lawson.

The news comes as the Kinder Foundation announced an $18.5 million expansion project for Emancipation Park in the heart of Third Ward. That historic park was founded by slaves in 1872.

The Kinders are one of the wealthiest couples in the nation, worth $11.4 billion, according to Forbes. You've certainly seen the Kinder name on buildings and facilities around the city of Houston.

The Kinders are also among the most generous, giving away hundreds of millions to Houston institutions and charities. Their plan is to give away almost all of their wealth, or more than $10 billion.

Rich Kinder helped build oil and gas pipeline giant Kinder Morgan, but he stepped down as CEO more than a decade ago for a what he calls a bigger cause.

"Well, I think we'd all like to leave the world a little better place than we found it," he said. "And we just felt early on that the right thing to do was to try to give most or all of that away. So that's what we plan to do during our lifetime and after our death."

They found kindred spirits as one of the first couples to sign The Giving Pledge, established by billionaires Bill and Melinda Gates and Warren Buffett.

---

Continue reading the full story, with video, on ABC13.com.