How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

From Your Site Articles
ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

2 Houston space tech cos. celebrate major tech milestones

big wins

Two Houston aerospace companies — Intuitive Machines and Venus Aerospace — have reached testing milestones for equipment they’re developing.

Intuitive Machines recently completed the first round of “human in the loop” testing for its Moon RACER (Reusable Autonomous Crewed Exploration Rover) lunar terrain vehicle. The company conducted the test at NASA’s Johnson Space Center.

RACER is one of three lunar terrain vehicles being considered by NASA for the space agency’s Artemis initiative, which will send astronauts to the moon.

NASA says human-in-the-loop testing can reveal design flaws and technical problems, and can lead to cost-efficient improvements. In addition, it can elevate the design process from 2D to 3D modeling.

Intuitive Machines says the testing “proved invaluable.” NASA astronauts served as test subjects who provided feedback about the Moon RACER’s functionality.

The Moon RACER, featuring a rechargeable electric battery and a robotic arm, will be able to accommodate two astronauts and more than 880 pounds of cargo. It’s being designed to pull a trailer loaded with more than 1,760 pounds of cargo.

Another Houston company, Venus Aerospace, recently achieved ignition of its VDR2 rocket engine. The engine, being developed in tandem with Ohio-based Velontra — which aims to produce hypersonic planes — combines the functions of a rotating detonation rocket engine with those of a ramjet.

A rotating detonation rocket engine, which isn’t equipped with moving parts, rapidly burns fuel via a supersonic detonation wave, according to the Air Force Research Laboratory. In turn, the engine delivers high performance in a small volume, the lab says. This savings in volume can offer range, speed, and affordability benefits compared with ramjets, rockets, and gas turbines.

A ramjet is a type of “air breathing” jet engine that does not include a rotary engine, according to the SKYbrary electronic database. Instead, it uses the forward motion of the engine to compress incoming air.

A ramjet can’t function at zero airspeed, so it can’t power an aircraft during all phases of flight, according to SKYbrary. Therefore, it must be paired with another kind of propulsion, such as a rotating detonation rocket engine, to enable acceleration at a speed where the ramjet can produce thrust.

“With this successful test and ignition, Venus Aerospace has demonstrated the exceptional ability to start a [ramjet] at takeoff speed, which is revolutionary,” the company says.

Venus Aerospace plans further testing of its engine in 2025.

Venus Aerospace, recently achieved ignition of its VDR2 rocket engine. Photo courtesy of Venus Aerospace

METRO rolls out electric shuttles for downtown Houston commuters

on a roll

The innovative METRO microtransit program will be expanding to the downtown area, the Metropolitan Transit Authority of Harris County announced on Monday.

“Microtransit is a proven solution to get more people where they need to go safely and efficiently,” Houston Mayor John Whitmire said in a statement. “Connected communities are safer communities, and bringing microtransit to Houston builds on my promise for smart, fiscally-sound infrastructure growth.”

The program started in June 2023 when the city’s nonprofit Evolve Houston partnered with the for-profit Ryde company to offer free shuttle service to residents of Second and Third Ward. The shuttles are all-electric and take riders to bus stops, medical buildings, and grocery stores. Essentially, it works as a traditional ride-share service but focuses on multiple passengers in areas where bus access may involve hazards or other obstacles. Riders access the system through the Ride Circuit app.

So far, the microtransit system has made a positive impact in the wards according to METRO. This has led to the current expansion into the downtown area. The system is not designed to replace the standard bus service, but to help riders navigate to it through areas where bus service is more difficult.

“Integrating microtransit into METRO’s public transit system demonstrates a commitment to finding innovative solutions that meet our customers where they are,” said METRO Board Chair Elizabeth Gonzalez Brock. “This on-demand service provides a flexible, easier way to reach METRO buses and rail lines and will grow ridership by solving the first- and last-mile challenges that have hindered people’s ability to choose METRO.”

The City of Houston approved a renewal of the microtransit program in July, authorizing Evolve Houston to spend $1.3 million on it. Some, like council member Letitia Plummer, have questioned whether microtransit is really the future for METRO as the service cuts lines such as the University Corridor.

However, the microtransit system serves clear and longstanding needs in Houston. Getting to and from bus stops in the city with its long blocks, spread-out communities, and fickle pedestrian ways can be difficult, especially for poor or disabled riders. While the bus and rail work fine for longer distances, shorter ones can be underserved.

Even in places like downtown where stops are plentiful, movement between them can still involve walks of a mile or more, and may not serve for short trips.

“Our microtransit service is a game-changer for connecting people, and we are thrilled to launch it in downtown Houston,” said Evolve executive director Casey Brown. “The all-electric, on-demand service complements METRO’s existing fixed-route systems while offering a new solution for short trips. This launch marks an important milestone for our service, and we look forward to introducing additional zones in the new year — improving access to public transit and local destinations.”

———

This article originally ran on CultureMap.

Cart.com's M&A move, energy innovators recognized, and more top articles from the week

trending news

Editor's note:Let's roundup the most-read Houston innovation news from the week. Trending Houston tech and startup articles from InnovationMap and its daily newsletter included a new health tech grant for Houston researchers, Cart.com's latest acquisition, and more.

Houston med school lands $3.5M grant to rollout genetic telehealth platform for underserved newborns

Baylor College of Medicine received $3.5 million to expand its telehealth platform to improve genomic diagnostics and care for critically ill newborns in underserved neonatal intensive care units in West and South Texas. Photo by Tim Bish on Unsplash

Baylor College of Medicine received $3.5 million to help hospitals in Texas better care for and diagnose some of the state's most vulnerable patients.

The funds come from the National Human Genome Research Institute for the Making Genomics Accessible to Newborns in Texas, or MAGNET, program. They'll be used to adapt BCM's Consultagene telehealth platform to be used in underserved neonatal intensive care units in West and South Texas, according to a statement.

Families in this region of the state currently can travel up to 300 miles to reach the nearest in-state geneticist, according to MAGNET. The program aims to help close that gap through BCM's established remote consultation service. Investigators also plan to create educational videos in English and Spanish to educate providers and patient caregivers on genetic diagnoses.

“Only 20 years ago, less than 3 percent of genetic conditions in newborns could be molecularly diagnosed,” Dr. Brendan Lee, co-principal investigator and professor and chair of the Department of Molecular and Human Genetics and Robert and Janice McNair Endowed Chair in Molecular and Human Genetics at BCM, says in a statement. Continue reading.

Houston e-commerce platform expands logistics network with acquisition of fulfillment operations arm

Cart.com has acquired OceanX, adding two new facilities and expanding its logistics network to enhance efficiency and support high-volume beauty, wellness, and lifestyle brands. Photo courtesy of Cart.com

A Houston e-commerce unicorn has made its latest strategic acquisition.

Cart.com, which operates a multichannel commerce platform, announced that it has acquired Guthy-Renker's wholly-owned fulfillment operations arm OceanX. The terms of the deal were not disclosed. Around 200 OceanX employees will be assumed onto the Cart.com team, and the fast-growing company will add two new facilities totaling over 600,000 square feet to its network, expanding to include a West Coast distribution hub in Southern California and its third facility near Columbus, Ohio.

"Acquiring OceanX is part of Cart.com’s strategy to continue to scale our platform and capabilities across industries, leveraging our proprietary technology to improve efficiency and deliver superior results to our clients and their customers,” Omair Tariq, Cart.com founder and CEO, says in a news release. “By deploying our Constellation OMS and WMS software and seasoned operations team across these two new facilities, we will improve order visibility, labor efficiency, shipping costs and customer satisfaction for the benefit of our new clients.” Continue reading.

3 clean energy innovators make Forbes list of top young energy professionals

Three young professionals have made the cut for this year's Forbes Under 30 list in the Energy and Green Tech list for 2025. Photos via Forbes

A handful of Houstonians have been named to the Forbes 30 Under 30 Energy and Green Tech list for 2025.

Kip Daujotas is an investment associate at Aramco Ventures, a $7.5 billion venture capital arm of the world's largest energy company. Houston is the Americas headquarters for Saudi Aramco. Since its inception in 2012, Aramco Ventures has invested in more than 100 tech startups. Daujotas joined the team over two years ago after studying for an MBA at Yale University. He led Aramco’s first direct air capture (DAC) investment — in Los Alamos, New Mexico-based Spiritus.

Also representing the corporate side of the industry, Wenting Gao immigrated from Beijing to obtain an economics degree from Harvard University, then got a job at consulting giant McKinsey, where she recently became the firm’s youngest partner. Gao works on bringing sustainability strategies to energy and materials companies as well as investors. Her areas of expertise include battery materials, waste, biofuels, and low-carbon products.

Last but not least, Houston entrepreneur Rawand Rasheed is co-founder and CEO of Houston-based Helix Earth. He co-founded the startup after earning a doctoral degree from Rice University and co-inventing Helix’s core technology while at NASA, first as a graduate research fellow and then as an engineer. The core technology, a space capsule air filtration system, has been applied to retrofitting HVAC systems for commercial buildings. Continue reading.

Rice University, Houston Methodist launch new institute to revolutionize health care through AI, innovation

Rice University and Houston Methodist have partnered to create the Digital Health Institute, combining advanced technology, artificial intelligence, and interdisciplinary expertise to transform health care. Photos courtesy

Rice University and Houston Methodist have established through a multi-year joint effort the Digital Health Institute, which aims to transform healthcare through advanced technology and the collaborative expertises of the university and hospital.

Rice’s leadership in engineering, digital health and artificial intelligence will combine with Houston Methodist’s academic medicine and research infrastructure.

“This partnership embodies Rice’s bold vision to lead at the forefront of innovation in health and responsible AI,” Rice President Reginald DesRoches says in a news release. “By combining our strengths with Houston Methodist, we are creating a transformative platform to address critical challenges in healthcare with solutions that are ethical, accessible and impactful. This initiative exemplifies our commitment to driving interdisciplinary collaboration and advancing global health for the benefit of humanity.” Continue reading.

2 Houston professors named as fellows for prestigious group of inventors

Omid Veiseh from Rice University and Edward Ratner from the University of Houston have been named 2024 National Academy of Inventors fellows for their innovative contributions. Courtesy photos

The highest professional distinction awarded to academic inventors, the National Academy of Inventors, have elected two fellows from Rice University and the University of Houston for its 2024 class.

Edward Ratner, computer information systems lecturer in the Department of Information Science Technology at the University of Houston’s Cullen College of Engineering, and Omid Veiseh, bioengineer at Rice University and director of the Biotech Launch Pad, were two of the 170 honorees representing 39 states and 12 countries.

The 2024 class will be honored and presented their medals on June 26 in Atlanta, Georgia by a senior official of the U.S. Patent and Trademark Office. Continue reading.

View All Listings