How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Houston-based Fervo Energy bumps up IPO target to $1.82 billion

IPO update

Houston-based geothermal power company Fervo Energy is now eyeing an IPO that would raise $1.75 billion to $1.82 billion, up from the previous target of $1.33 billion.

In paperwork filed Monday, May 11 with the U.S. Securities and Exchange Commission, Fervo says it plans to sell 70 million shares of Class A common stock at $25 to $26 per share.

In addition, Fervo expects to grant underwriters 30-day options to buy up to 8.33 million additional shares of Class A common stock. This could raise nearly $200 million.

When it announced the IPO on May 4, Fervo aimed to sell 55.56 million shares at $21 to $24 per share, which would have raised $1.17 billion to $1.33 billion. The initial valuation target was $6.5 billion.

A date for the IPO hasn’t been scheduled. Fervo’s stock will be listed on Nasdaq under the ticker symbol FRVO.

Fervo, founded in 2017, has attracted about $1.5 billion in funding from investors such as Bill Gates-founded Breakthrough Energy Ventures, Google, Mitsubishi Heavy Industries, Devon Energy (which is moving its headquarters to Houston), Tesla co-founder JB Straubel, CalSTRS, Liberty Mutual Investments, AllianceBernstein, JPMorgan, Bank of America and Sumitomo Mitsui Trust Bank.

Fervo’s marquee project is Cape Station in Beaver County, Utah, the world’s largest EGS (enhanced geothermal system) project. The first phase will deliver 100 megawatts of baseload clean power, with the second phase adding another 400 megawatts. The site can accommodate 2 gigawatts of geothermal energy. Fervo holds more than 595,000 leased acres for potential expansion.

Cape Station has secured power purchase agreements for the entire 500-megawatt capacity. Customers include Houston-based Shell Energy North America and Southern California Edison.

---

This article originally appeared on our sister site, EnergyCapitalHTX.com.

Texas university's new flight academy opens at Houston Spaceport

cleared for takeoff

The vehicles may not have “student driver” stickers on them, but Texas Southern University has moved a dozen planes into its new training facility at the Houston Spaceport, opening the way for student flyers to use the facility.

TSU previously reached a deal with Houston Airports and the City of Houston in 2023 to house its prospective Flight Academy at Ellington Field. At the time, TSU had a small fleet of nine planes for student use, but a $5.5 million investment from the city greatly expanded the space available.

The Flight Academy includes a 20,000-square-foot hangar that serves as a TSU satellite campus. The school now has a fleet of 12 Cirrus SR20 aircraft that were acquired last year through state and alumni funding. An additional 4,500 square feet is used as classroom and office space. An 8,000-gallon fuel tank will support flight training operations.

TSU first launched its Aviation Science Management program in 1986 and added a professional pilot program in 2016. The school is now part of the United Airlines pipeline program and has also forged relationships with Delta and Southwest.

“I want to commend Texas Southern University and Houston Airports for their leadership and partnership in advancing aviation education right here in our city,” Houston City Councilwoman Dr. Carolyn Evans-Shabazz in a press release.

“It connects our students to high-paying, high-demand careers in aviation and aerospace. This is how we grow a city in the right way—by investing in workforce development, aligning education with industry and making sure our residents are prepared to lead in the industries of tomorrow. Houston is already a global leader in aerospace and projects like this strengthen that position even further, especially here at Ellington, where innovation and opportunity continue to take flight.”

The City of Houston signed an agreement to continue funding the academy for five years.

Amazon launches ultrafast, 30-minute delivery service across Houston

Amazon Now

More than 20 years after it redefined fast shipping, Amazon is preparing to raise the bar on consumer expectations again by offering to fulfill customers' most urgent product needs in Houston and other parts of the world in a half-hour or less for an extra fee.

The company, which revolutionized online shopping in 2005 with two-day deliveries for Prime members, is rapidly opening small order-processing hubs in dozens of U.S. and foreign cities to cater to shoppers who can't or don't want to wait for cough medicine to relieve flu symptoms or tomatoes for tonight's dinner salad.

The ultrafast service, called Amazon Now, first launched in India last June. Amazon says 30-minute deliveries now are also available in urban areas of the United States, Brazil, Mexico, Japan, the United Arab Emirates, the United Kingdom.

The mini-warehouses devoted to Amazon Now are about the size of a CVS drugstore. They stock about 3,500 products for expedited delivery, including beer, diapers, pet food, meat, nonprescription medications, playing cards and cellphone charging cables.

“We know that customers love speed and always have,” Beryl Tomay, Amazon’s head of transportation, told The Associated Press on Monday. “What we see customers doing, when we offer faster speeds, are they purchase more from Amazon. And Amazon becomes more top of mind for that or other types of items as well.”

In the U.S., the company first tested Amazon Now in Seattle, the home of its headquarters, and in Philadelphia. Most residents of the Dallas-Fort Worth area and Atlanta now have access as well. The service is also live in Dallas-Fort Worth, Denver, Minneapolis, Phoenix, Oklahoma City, Orlando, and dozens of other cities, Amazon said, with New York City and others expected by year-end.

The service charges for Amazon Now start at $3.99 for Prime members, who pay an annual fee of $139, and $13.99 for non-members. A $1.99 small basket fee applies to orders under $15, Amazon said.

The company's bet on a need for speed also comes as some consumers are rebelling against rushed deliveries as they weigh the potential impact on the environment and the workers tasked with preparing orders at a rapid rate.

Amazon’s approach
A relentless focus on speed helped Amazon build a logistics and e-commerce empire. After it made two days the new delivery time normal, Amazon moved into one-day and same-day deliveries for its Prime members. This spring, the company began making 90,000 products available in one hour or three hours at an extra cost.

The scaled down and sped up microhubs that are designed to handle 30-minute orders represent another step in Amazon's pursuit.

Only a handful of people prepare orders from aisles of shelves in the 5,000- to 10,000-square-foot facilities, unlike the sprawling fulfillment centers storing millions of items where Amazon employs a mix of human workers and robotics to pick and pack orders.

Amazon tailors the product inventory to each location and uses artificial intelligence and other technology to analyze what customers buy, as well as when and how often. The most popular U.S. purchases so far include soap, toothpaste, mouthwash, toilet plungers, bananas, limes and wireless earbuds, Amazon said.

The competition
Amazon’s attempt to up the instant gratification ante provides direct competition to on-demand food delivery platforms like Instacart, Uber Eats, DoorDash and Grubhub, which don't have the scale of the e-commerce titan, according to independent retail analyst Bruce Winder.

“What Amazon brings is their prowess in supply chain,” Winder said.

These smaller companies said they don't see Amazon as a threat, though, citing the hundreds of thousands of items they are able to deliver to users' doorsteps by partnering with various merchants and restaurants.

“DoorDash has a mission to empower grocers and retailers and augment their existing footprint, not to replace them,” DoorDash spokesperson Ali Musa said in an emailed statement. “We win only when they win, which is how we can offer over half a million grocery and retail items in under an hour across the country.”

Amazon also is in a race with Walmart to become the retailer that reliably gets orders to online shoppers in under an hour.

For an additional $10 on top of standard delivery charges, shoppers can place Walmart Express Delivery orders from among more than 100,000 products that are guaranteed to arrive in an hour. Many customers, however, are receiving the items under 30 minutes, Walmart CEO John Furner told analysts in February.

Domino's cautionary tale
Companies have promised deliveries in 30 minutes or less before, but the landscape also is littered with failed attempts to break the speed barrier.

The COVID-19 pandemic produced a flurry of companies that promised 10- to 15-minute grocery deliveries from microwarehouses in dense neighborhoods, according to Sucharita Kodali, an analyst at market research firm Forrester Research.

But soaring operating costs, low customer loyalty and the drying up of investor money ultimately caused most to fail before the pandemic was over, analysts said.

Domino’s in 1984 pushed a guarantee that customers would receive their pizzas for free if they weren't delivered in under a half-hour. The company amended the “30 minutes or it’s free” policy after two years, providing only a $3 discount for late deliveries.

The promotion helped Domino’s win market share, but it ended up tarnishing the company's reputation. It dropped the guarantee in December 1993 after a string of crashes and lawsuits involving drivers racing to meet the deadline.

Brad Jashinsky, a retail analyst at information technology research and consulting firm Gartner, said he thinks Amazon should take the pizza chain's experience as a cautionary tale.

“You get in trouble when you start overpromising something like that,” he said.

Amazon won't be making any time guarantees and instead plans to keep customers who chose the 30-minute delivery option updated on the progress of their orders, Tomay said.

“There's no rushing either in our building workers or the gig workers,” she said.

Taking it slow
Kodali thinks Amazon will need a lot of people placing orders around the same time from the same or adjacent apartment buildings for the 30-minute service to be cost-effective.

Consumers may appreciate rapid receipt of products like toilet paper and batteries, but retailers and logistics experts said they also see some online shoppers, especially members of Generation Z, choosing no-rush shipping for products they don't need in a hurry.

Amazon for several years has invited customers to skip one- or two-day delivery and to receive their orders on the same day in as few parcels as possible. Consolidating orders into fewer packages by electing to have them delivered at the same time cuts down on boxes, shipping envelopes and fuel use, analysts said.

“The millennials who came to age in an era that was on fast delivery came to expect it de facto, whereas ... Gen Z is more accepting of a slower speed than previous generations before them,” said Darby Meegan, a general manager at Flexport, a supply chain and logistics company that fulfills orders for thousands of online merchants.

Still, Amazon executives have cited positive early results for Amazon Now in India, where they said Prime members tripled their requests for 30-minute deliveries once they started using the service.

Amazon Now also is attracting more repeat American customers, Tomay said.

“It’s in early days and time will tell,” she said. “I think that it will be interesting to see how it evolves.”