How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Baylor College of Medicine launches VC fund to invest in biotech startups

fresh funding

Houston’s Baylor College of Medicine just unveiled a new venture capital fund that backs early-stage biotech startups—and it’s already made its first investment.

BCM Legacy Fund I, funded by philanthropies, invested an undisclosed amount in Houston biotech startup Nemea Therapeutics. Nemea, a spinout of the Baylor College of Medicine and Germany’s Lead Discovery Center, is developing an oral drug to treat metastatic triple-negative breast cancer that no longer responds to currently available therapies.

This type of aggressive cancer spreads from the breast to other areas of the body, such as the bones, liver, lungs or brain. Roughly 38,000 to 57,000 Americans are diagnosed each year with metastatic triple-negative breast cancer. One study showed about half of patients survive past the one-year mark following diagnosis and about one-third survive two years.

“Baylor College of Medicine’s laboratories produce discoveries with the potential to change patients’ lives, and too many of them stall where academic funding ends and private investment has not yet begun,” Dr. Jakub Tolar, president, CEO and executive dean of the Baylor College of Medicine, said in a press release. “The BCM Legacy Fund fills that gap, giving our scientists a path to advance their discoveries to patients.”

The National Institutes of Health awards more than $36 billion per year for biomedical research in the U.S., Baylor said. But some biomedical discoveries “never leave the starting line because they don’t yet fit the economics of venture capital,” the college said.

“The forefront of a new model”

The BCM Legacy Fund aggregates philanthropic capital from private foundations and donor-advised funds. It then invests in startups so they can move beyond that starting line and into later-stage investment rounds. The Greater Houston Community Foundation is the fund’s philanthropic partner.

“It’s exciting to be on the forefront of a new model for philanthropic capital,” said Houston entrepreneur and investor Burton Hanson, managing partner of the fund.

“Not only do we hope to solve a real problem by advancing these therapies to the patients who need them most, but we also hope this model will inspire others in the city and beyond toward philanthropic creativity and a posture of ‘I sacrifice; we win.’”

The fund expects to invest in about 15 early-stage startups over a five-year span. Baylor declined to divulge the amount of money in the fund and the size of the investment in Nemea.

Nemea’s “world-class chemistry”

Hanson oversees the Baylor fund alongside Chicago investor Steve Lehmann, who led the University of Chicago’s Innovation Fund.

Lehmann said Nemea, the fund’s first portfolio company, “has world-class chemistry, Baylor biology, and patients with no good options. Our job is to fund the experiments that carry it to the next handoff, so that industry and later-stage investors can take it from there.”

Based at Houston’s massive Texas Medical Center, Nemea plans to start clinical trials next year in collaboration with Baylor’s Lester and Sue Smith Breast Center.

Nemea previously received $9 million from the Lead Discovery Center and a $1.6 million grant from Baylor. Last year, the startup said it was seeking $25 million to $30 million in seed and Series A funding.

Debra McCoy of Houston, a former managing director at BlackRock and former partner at Bain & Co., and Paul Thomas, co-founder and CEO of Spring-based benefits manager Luscinia Health, sit on the Baylor fund’s governing board. Dr. Paul Klotman, former president, CEO and executive dean of Baylor, is a senior strategic adviser.

How does the fund find investment targets?

The Baylor Legacy Fund relies on two tools to help unearth early-stage biotech startups:

  • High-resolution “innovation maps” of research institutions. These maps surface hidden clusters of innovation, identify rising-star researchers and tie pockets of “innovation supply” at Baylor to areas of “innovation demand” in biotech.
  • AI-enhanced due diligence. AI agents assist with due diligence of early-stage biotech startups. The fund says the platform “distills the frameworks we’ve developed over a decade of teaching and investing into a flexible … diligence environment.”

MD Anderson unveils $3.4B expansion with two new Houston cancer care facilities

major expansion

The cutting edge of cancer-fighting technology and science is getting even sharper after MD Anderson announced last week that it will open two new facilities in the Texas Medical Center within the next five years. Inspiration Tower and Prism will expand MD Anderson’s annual patient load in the TMC to 250,000 annually and will incorporate a variety of new techniques.

The $3.4 billion project will add 2 million square feet to MD Anderson's TMC footprint, bringing its total campus size to 22 million square feet by 2032. Located at the corner of Fannin Street and Holcombe Boulevard, the cancer center says the two new facilities will serve as its new "front door" to the TMC.

“Every detail of these buildings, from the technology to the treatment rooms, was designed around our patients who will receive their care in them and our employees who will work in them. The facilities will serve as a physical representation of hope for the patients and their families who will walk through the doors,” Dr. Jeffrey E. Lee, president ad interim of UT MD Anderson, said in a news release. “Inspiration Tower and Prism are the future of cancer care, and we are grateful for the longstanding support and guidance we’ve received from the UT System Board of Regents to bring these projects to life. These facilities are part of the most impactful capital expansion in UT MD Anderson’s history.”

Prism is especially exciting as it will represent fully half of the linear accelerator treatment in the TMC. Linear accelerator is a radiation treatment that uses magnetically charged fields to deliver targeted external radiation therapy, like shooting cancer with a rail gun. The treatment is safer and has fewer side effects than older radiation treatments.

In addition, Prism will contain 12 MRI machines, four CT scanners, two PET-CT units, 18 radiation vaults and seven radiation simulators. Patient comfort has also been put at a premium with multiple gardens and roof overlooks.

“Every patient we treat deserves an environment that reflects the excellence of the care they receive at UT MD Anderson,” Chris McKee, executive vice president and chief strategy officer at UT MD Anderson, added in the release. “Our new facilities will be innovative, agile, adaptable and beautiful, and they will allow us to care for more patients, more effectively – in an environment that enhances healing and well-being. We are building for our future and for every patient who will be counting on us.”

Prism is slated to open in 2030.

Inspiration Tower will have 25 floors of surgical, diagnostic, and treatment services. At 1.4 million square feet, it’s currently expected to be the largest cancer-specific treatment facility in the United States. The tower will be divided into units for specific types of cancer, making it easy to integrate the advancing research being done all over Houston.

Like Prism, Inspiration Tower is specifically designed to offer comfort and reassurance, with more garden space, terraces, and beautiful scenery to ease patient distress. It is expected to open in 2032.

Tesla will pull the plug on Cybertruck production at Texas factory in 2027

Tesla Talk

Tesla’s Cybertruck, the hulking, stainless-steel pickup that inspired devotion and derision with its science-fiction looks, will cease production next year.

CEO Elon Musk announced the model’s demise Friday, November 6, with a curt post on X, his social media site, simply noting production of the vehicle “will be winding down” around the middle of 2027 at its facility outside Austin, Texas. Musk said the move was to allow increased production of its Cybercab robotaxi.

For the Cybertruck, a pet project of Musk who insisted it was Tesla’s best product, it marks an unceremonious end to one of the auto industry’s most ballyhooed debuts.

“Few vehicles in history have generated as much attention,” said Armen Hareyan, whose Torque News site covers autos. “The Cybertruck became a cultural symbol – loved, mocked and impossible to ignore.”

The Cybertruck rolled onto the scene in a dramatic unveiling in 2019, when a Tesla designer hurled a metal ball at the vehicle to demonstrate its supposedly unbreakable glass, only to see it shatter. He repeated the stunt on another window of the truck only to shatter that one, too.

Even as some critics scoffed, Musk was steadfast.

“I just wanted to make a futuristic battle tank — something that looks like it could come out of ‘Blade Runner’ or ‘Aliens’ or something like that but was also highly functional,” he told Automotive News. He called it “a better sports car than a Porsche 911” and “a better truck than an F-150.”

It struck some as the perfect vehicular reflection of the brash, convention-busting Musk.

“A really controversial vehicle unveiled by a controversial individual into a market where none of the electric trucks have been able to really capture demand,” said Spencer Penn, a former Tesla executive who left the company before the Cybertruck’s launch and now heads software developer LightSource.

Penn remembered watching the unveiling and feeling initially revolted by the sight of the Cybertruck, calling its appearance “madness.” But the more he looked at it, the more his opinion changed. He signed up for a pre-sale reservation, though ended up not getting a Cybertruck when Musk’s promises of a price tag under $40,000 went unmet and the first trucks sold for double or more. Penn called the Cybertruck part of Tesla’s adventurous spirit that drives innovation.

“Some of these bets work and some of these bets don’t,” he said.

While the decision to end Cybertruck production may be driven by sales realities, it's also a reflection of Tesla’s shift to autonomous vehicles, on which Musk is betting the company’s future.

Musk once forecast he’d make 250,000 Cybertrucks a year. Kelley Blue Book estimated Tesla sold just 20,237 of the vehicles last year, down about half from the year prior. Sales through the end of September this year were down another 28%, according to Kelley Blue Book.

If the imposing, sharp-angled, dystopian appearance of the Cybertruck weren’t enough to turn many potential buyers away, Musk did so himself by allying with a panoply of right-wing figures, most notably U.S. President Donald Trump. He alienated some customers as his image morphed from eccentric innovator to polarizing force trading his billions for political influence.

Once-passionate Tesla drivers rushed to sell off their cars, or slapped stickers on the bumper declaring, “I bought this before Elon went crazy.” Organizers staged demonstrations outside Tesla showrooms and urged investors to dump shares of the company’s stock. Anger spilled into violence, with Molotov cocktails hurled at Tesla vehicles, charging stations set ablaze, and dealerships covered in graffiti.

Lovers of the Cybertruck became targets, too, subjected to shouts of “Nazi!” and extended middle fingers.

Ross Blankenship is one of them. When he first laid eyes on the Cybertruck, he felt transported to a world from his childhood, when he would play “Halo,” the sci-fi video game. He had to have it.

“I had that sort of child in me wanting to be part of something cool that would change the future of automotive,” Blankenship said in a call from his Cybertruck as he drove through Sunnyside, Colorado. Even as Blankenship found he agreed with Musk on politics, he hated seeing a vehicle he loved turned into a political symbol. “I never bought it for any other reason than the fascination with the future technology of trucks … so that was a little heartbreaking.”

He would buy another Cybertruck again in a heartbeat, calling its end “a sad moment.”