How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."

These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

From Your Site Articles

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100

Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

Elon Musk's SpaceX is about to make its debut on Wall Street

Money Moves

Elon Musk's rocket company SpaceX will make its debut on Wall Street Friday, June 12, and both institutional and retail investors are expected to gobble up the 555.6 million shares going up for sale at $135 apiece. Musk, already the world's richest man, could become its first trillionaire.

SpaceX is likely to become the biggest IPO ever, with proceeds of around $75 billion. SpaceX hopes to become the first company to send people to Mars. In fact, part of Musk’s future compensation depends on SpaceX eventually establishing a colony of at least 1 million people on the red planet.

Why SpaceX is going public now

In a video conference on Musk's social media platform X, he told JPMorgan CEO Jamie Dimon that people have suggested for the last 10 years that he take SpaceX public. He's doing it now because the company plans to put 100,000 next-generation Starlink satellites into orbit. Deploying AI data centers in space is a “massive new growth base and you need capital for that,” he said.

Going public provides access to the capital that SpaceX needs. But it also exposes it to more scrutiny from shareholders and more regulatory oversight. That includes filing quarterly financial reports, which critics say incentivizes short-term thinking over longer-term planning and creates unnecessary costs for a company. Securities regulators are currently soliciting public comment on a proposal to require public companies to file the financial reports only twice every year.

How the IPO impacts the company

Musk will hold the majority of a special class of shares, giving him control over decisions related to company strategy, finances and personnel. On the latter, because of his ownership of most of these Class B shares, the only person who can fire Musk as CEO is Musk.

The company credits Musk with being the “driving force” behind its growth, innovation and success. But what happens if Musk is no longer in the picture? SpaceX warns that the loss of Musk could disrupt its ability to execute its strategy as well as hurt its “reputation and relationships with customers, partners and other stakeholders.”

The company also warns that finding a replacement with the same skills and experience as Musk would be time-consuming, if not nearly impossible. As Wedbush Securities analyst Dan Ives wrote Wednesday, “At the end of the day Musk is SpaceX and SpaceX is Musk.”

What could make or break SpaceX

Currently in the test phase, the gigantic reusable Starship rocket is key to SpaceX realizing Musk's ambitions. Much of the commercial space business hinges on SpaceX developing Starship’s capability to be fully reusable and hearty enough for a quick turnaround between flights. If that doesn't happen, SpaceX warns that putting data centers and satellites in space will take longer and cost more money, meaning it risks customers bailing on the company.

Analysts say that by pioneering reusable rockets, SpaceX has established a clear lead on competitors such as Blue Origin, led by Amazon founder Jeff Bezos. The Starlink satellite business competes with, among others, AST SpaceMobile – which is relying on a SpaceX rocket to send its latest generation of satellites into orbit next week.

The prospectus filed last week says SpaceX’s biggest potential market is the sale of business-oriented artificial intelligence products designed to transform how people get work done. It’s an opportunity SpaceX predicts would be worth $22.7 trillion if it could somehow dominate rivals like Anthropic, OpenAI and Microsoft in a highly competitive industry. But the prospectus shows no clear path to profitability for the xAI business, which merged with SpaceX earlier this year.

Why Wall Street is paying attention

If the SpaceX IPO is as successful, the stock could quickly join the Nasdaq 100, a widely followed index that tracks the 100 largest non-financial companies in the composite. That's important because some popular funds, such as the $460 billion QQQ exchange-traded fund, mimic the index and will automatically buy whatever is listed in the index.

Nasdaq recently changed its rules to allow select companies to enter the Nasdaq 100 after just 15 trading days.

S&P Dow Jones Indices, on the other hand, is sticking to established and more traditional thresholds that will not allow SpaceX or other companies with gargantuan IPOs faster entry into its S&P 500 index. That means even high-profile companies will still need to wait for their stocks to trade a full 12 months before they can enter the index.

Companies want to be in the S&P 500 in particular because it's arguably the most important index on Wall Street, with trillions of dollars either mimicking it exactly or benchmarked against it. Vanguard's VOO fund that tracks the S&P 500 has roughly $950 billion invested in it, for example.

NASA unveils Artemis III astronauts at Johnson Space Center in Houston

To the moon

NASA on Tuesday, June 9, revealed the crew for its Artemis III mission, the next step in the space agency's plan to eventually land astronauts on the moon.

The announcement came two months after Artemis II's record-breaking trip around the moon that surpassed the distance record of Apollo 13.

NASA's Randy Bresnik, Frank Rubio, Andre Douglas and the European Space Agency's Luca Parmitano won't fly to the moon or land on the surface. Instead, they’ll orbit Earth while practicing docking their Orion capsule with two lunar landers.

“To the Artemis III crew, we wish you Godspeed on the journey ahead,” said NASA administrator Jared Isaacman.

Elon Musk’s SpaceX and Jeff Bezos’ Blue Origin are racing to deliver the lunar landers. The two-week demo is targeted for 2027. Blue Origin suffered a recent setback when its massive rocket exploded during an engine-firing test on the launch pad in Florida, shaking nearby homes and illuminating the sky with an orange fireball.

NASA's Jeremy Parsons said the setback is a learning opportunity and that the space agency is confident Blue Origin's rocket will be ready in time.

NASA's Artemis program aims to return astronauts to the moon's surface for the first time since the 1970s. A recent revamp of the program announced by Isaacman aims to fast-track it similarly to the Apollo era, adding the upcoming spaceflight around Earth before eyeing a lunar landing in 2028.

“We are certainly humbled as a crew to be able to be your crew that executes this Artemis III mission in space,” said Bresnik, Artemis III commander.

Added Douglas, mission specialist: “My brain — it is going a mile a minute right now. But my heart, it is so warm. It is so full."

In May, NASA awarded hundreds of millions of dollars in contracts to four companies, including Blue Origin, to build landers, rovers and drones for a future moon base. Isaacman said the goal of the moon base is to lay the foundation for a Mars expedition.

View All Listings

INNOVATIONMAP EMAILS ARE AWESOME