How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Houston hospital names leading cancer scientist as new academic head

new hire

Houston Methodist Academic Institute has named cancer clinician and scientist Dr. Jenny Chang as its new executive vice president, president, CEO, and chief academic officer.

Chang was selected following a national search and will succeed Dr. H. Dirk Sostman, who will retire in February after 20 years of leadership. Chang is the director of the Houston Methodist Dr. Mary and Ron Neal Cancer Center and the Emily Herrmann Presidential Distinguished Chair in Cancer Research. She has been with Houston Methodist for 15 years.

Over the last five years, Chang has served as the institute’s chief clinical science officer and is credited with strengthening cancer clinical trials. Her work has focused on therapy-resistant cancer stem cells and their treatment, particularly relating to breast cancer.

Her work has generated more than $35 million in funding for Houston Methodist from organizations like the National Institutes of Health and the National Cancer Institute, according to the health care system. In 2021, Dr. Mary Neal and her husband Ron Neal, whom the cancer center is now named after, donated $25 million to support her and her team’s research on advanced cancer therapy.

In her new role, Chang will work to expand clinical and translational research and education across Houston Methodist in digital health, robotics and bioengineered therapeutics.

“Dr. Chang’s dedication to Houston Methodist is unparalleled,” Dr. Marc L. Boom, Houston Methodist president and CEO, said in a news release. “She is committed to our mission and to helping our patients, and her clinical expertise, research innovation and health care leadership make her the ideal choice for leading our academic mission into an exciting new chapter.”

Chang is a member of the American Association of Cancer Research (AACR) Stand Up to Cancer Scientific Advisory Council. She earned her medical degree from Cambridge University in England and completed fellowship training in medical oncology at the Royal Marsden Hospital/Institute for Cancer Research. She earned her research doctorate from the University of London.

She is also a professor at Weill Cornell Medical School, which is affiliated with the Houston Methodist Academic Institute.

Texas A&M awarded $1.3M federal grant to develop clean energy tech from electronic waste

seeing green

Texas A&M University in College Station has received a nearly $1.3 million federal grant for development of clean energy technology.

The university will use the $1,280,553 grant from the U.S. Department of Energy to develop a cost-effective, sustainable method for extracting rare earth elements from electronic waste.

Rare earth elements (REEs) are a set of 17 metallic elements.

“REEs are essential components of more than 200 products, especially high-tech consumer products, such as cellular telephones, computer hard drives, electric and hybrid vehicles, and flat-screen monitors and televisions,” according to the Eos news website.

REEs also are found in defense equipment and technology such as electronic displays, guidance systems, lasers, and radar and sonar systems, says Eos.

The grant awarded to Texas A&M was among $17 million in DOE grants given to 14 projects that seek to accelerate innovation in the critical materials sector. The federal Energy Act of 2020 defines a critical material — such as aluminum, cobalt, copper, lithium, magnesium, nickel, and platinum — as a substance that faces a high risk of supply chain disruption and “serves an essential function” in the energy sector.

“DOE is helping reduce the nation’s dependence on foreign supply chains through innovative solutions that will tap domestic sources of the critical materials needed for next-generation technologies,” says U.S. Energy Secretary Jennifer Granholm. “These investments — part of our industrial strategy — will keep America’s growing manufacturing industry competitive while delivering economic benefits to communities nationwide.”

------

This article originally appeared on EnergyCapital.

Biosciences startup becomes Texas' first decacorn after latest funding

A Dallas-based biosciences startup whose backers include millionaire investors from Austin and Dallas has reached decacorn status — a valuation of at least $10 billion — after hauling in a series C funding round of $200 million, the company announced this month. Colossal Biosciences is reportedly the first Texas startup to rise to the decacorn level.

Colossal, which specializes in genetic engineering technology designed to bring back or protect various species, received the $200 million from TWG Global, an investment conglomerate led by billionaire investors Mark Walter and Thomas Tull. Walter is part owner of Major League Baseball’s Los Angeles Dodgers, and Tull is part owner of the NFL’s Pittsburgh Steelers.

Among the projects Colossal is tackling is the resurrection of three extinct animals — the dodo bird, Tasmanian tiger and woolly mammoth — through the use of DNA and genomics.

The latest round of funding values Colossal at $10.2 billion. Since launching in 2021, the startup has raised $435 million in venture capital.

In addition to Walter and Tull, Colossal’s investors include prominent video game developer Richard Garriott of Austin and private equity veteran Victor Vescov of Dallas. The two millionaires are known for their exploits as undersea explorers and tourist astronauts.

Aside from Colossal’s ties to Dallas and Austin, the startup has a Houston connection.

The company teamed up with Baylor College of Medicine researcher Paul Ling to develop a vaccine for elephant endotheliotropic herpesvirus (EEHV), the deadliest disease among young elephants. In partnership with the Houston Zoo, Ling’s lab at the Baylor College of Medicine has set up a research program that focuses on diagnosing and treating EEHV, and on coming up with a vaccine to protect elephants against the disease. Ling and the BCMe are members of the North American EEHV Advisory Group.

Colossal operates research labs Dallas, Boston and Melbourne, Australia.

“Colossal is the leading company working at the intersection of AI, computational biology, and genetic engineering for both de-extinction and species preservation,” Walter, CEO of TWG Globa, said in a news release. “Colossal has assembled a world-class team that has already driven, in a short period of time, significant technology innovations and impact in advancing conservation, which is a core value of TWG Global.”

Well-known genetics researcher George Church, co-founder of Colossal, calls the startup “a revolutionary genetics company making science fiction into science fact.”

“We are creating the technology to build de-extinction science and scale conservation biology,” he added, “particularly for endangered and at-risk species.”