How this Houston innovator is making AI accessible, personal, and safe

HOUSTON INNOVATORS PODCAST EPISODE 198

Anshumali Shrivastava joins the Houston Innovators Podcast to share the revolutionary work ThirdAI is doing for artificial intelligence. Photo via rice.edu

Anshumali Shrivastava's career has evolved alongside the rise of artificial intelligence. Now, he believes his company represents the future of the industry's widespread implementation.

Shrivastava, who's also a professor at Rice University, founded ThirdAI, pronounced "third eye," in 2021 to democratize artificial intelligence through software innovations. As Shrivastava explains on the Houston Innovators Podcast, AI processes have historically been run on larger, less accessible computing hardware. ThirdAI's tools are able to run on a regular central processing unit, or CPU, rather than the more powerful graphics processing unit, or GPU.

"We focus on the problems that people are facing in the current AI ecosystem," Shrivastava says on the podcast. "Right now, if you are to build some of the large-language models and (linear programming) models, you need a lot of computing power, dedicated engineers to move it, and, even if you are using fully managed services, it's costly and there are a lot of privacy implications because you have to move data around."



These are some of the challenges for AI development, and, as Shrivastava points out, this process isn't even accessible for 90 percent of the world that lacks the infrastructure to do it. And, even for companies that can afford to invest in the dedicated GPU hardware, there's a global chip shortage.

ThirdAI's solution? Enable AI processes on the hardware that is accessible — CPUs.

"That is what our product offerings are — the AI ecosystem on commodity infrastructure," he says, explaining that ThirdAI's goal is also to improve existing AI applications.

One specific AI application that ThirdAI is making more effective for its customers is search tools in ecommerce. The need to make online shopping searches as quick and as accurate as possible directly affects the company's ability to complete the transaction. Wayfair tapped into ThirdAI's tech to address its latency in its on-site searching.

"Their problem was in the domain of making language models and search engines, which are AI based, very efficient," Shrivastava says. "We were able to bring down (latency) significantly with our technology."

One AI application that's taken off over the past few years is the chat-based model — led by OpenAI's ChatGPT. As exciting as the prospect of navigating information via chatbot is, many companies, understandably, have privacy concerns.

ThirdAI created PocketLLM to address this concern. The platform, which ThirdAI offers for free, operates completely on the harddrive of the owner of the data, meaning your data stays with you.

"ChatGPT has shown the world what is possible," Shrivastava says, explaining that 80 or 90 percent of use cases are people or companies wanting to take their knowledge and data and turn it into an AI chat tool. "What people want is a ChatGPT-kind of agent on their data, but they don't want their proprietary data to be leaked to the outer world."

"Because I can build AI where your data is, your data never have to leave your ecosystem. PocketLLM is a demonstration of that capability," Shrivastava continues. "It's a tool that uses our software stack and essentially looks at your data and builds this chat agent and offers you an air-gapped privacy."

Shrivastava explains that the tool can be used for enterprises or even personal applications — like navigating past conversations on email, seeing as no email provider seems to have an optimized search option.

PocketLLM is just one thing ThirdAI is working on. Shrivastava explains that the company is developing an entire ecosystem of tools that can be used on CPUs.

"If AI is going to be an agent, it better be personalized," he says, explaining that no one AI will have the right answer for everyone.

Shrivastava shares more about the future of both AI and ThirdAI, which is growing to keep up with demand. Listen to the interview here — or wherever you stream your podcasts — and subscribe for weekly episodes.

ThirdAI's new PocketLLM app is free to use and completely secure. Photo via Getty Images

Houston startup launches innovative chat tool on its mission to democratize AI

smart tech

Artificial intelligence has a big potential to disrupt the technology industry, and one Houston company that was founded by a computer science professor at Rice University, is fast on its way to help lead that future now in a convenient and affordable way.

Founded by Anshumali Shrivastava and Tharun Medini, a recent Ph.D. who graduated under Shrivastava from Rice's Department of Electrical and Computer Engineering, ThirdAI is building AI deep learning tools that aim to be sustainable and scalable to fit the changing needs of the industry. The company is on a mission to democratize AI, Shrivastava tells InnovationMap.

Shrivastava likes to use the word efficiently when describing what makes ThirdAI different, and how its programs can teach AI via multiple avenues to be what he refers to as “1,000 times more efficient.”

“The carbon footprint of these models are off the charts, and so expensive,” Shrivastava. “We believe this could be made efficient. … We use the same ideas that were developed, but we do it on a massive scale.”

ThirdAI's latest tool is a multilingual ChatGPT-like AI training tool PocketLLM app. Announced earlier this month, the tool is free. According to the company, users have access to a personalized chatbot that understands what the user is searching within documents, and can be fine-tuned to help elaborate your thoughts through a neural search.

ThirdAI's PocketLLM app is free to use. Image courtesy of ThirdAI

The app is private and secure and runs on deep-learning algorithms according to Vinod Iyengar, head of product at ThirdAI, and no one — not even ThirdAI — has access to the documents except the user.

“Tools exist to help people search text files, but that requires sharing your data with third parties,” says Iyengar in a news release. “Our solution is private and secure, powered by deep learning algorithms. And it returns results lightning fast.”

The process includes the user installing the app, uploading any text document files, and clicking "train." Minutes later, you have an AI tool that can process the information in those documents.

“The neural search encourages you to elaborate on your thoughts with details in the discover window and see the difference in results,” says Shrivastava in the release. “It can also be fine-tuned to your tastes by selecting the relevant option and hitting the update button to re-train."

In September of 2021, ThirdAI — pronounced "third eye" — raised $6 million in seed funding. The round was invested in by three California-based VCs — Neotribe Ventures and Cervin Ventures, which co-led the round with support from Firebolt Ventures. The technology ThirdAI is working with comes from 10 years of deep learning research and innovation. The company's technology has the potential to make computing 15-times faster, the company reports.

Anshumali Shrivastava is an associate professor of computer science at Rice University. Photo via rice.edu

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

$100M Houston VC fund launches to back technical founders

show me the money

A new venture capital fund has launched with an initial $100 million mission of supporting founders with innovative critical infrastructure solutions.

Fathom Fund, which is looking to build out a portfolio of advanced computing, material science, climate resilience, and aerospace startups, announced they've launched with an initial close of over $100 million. The fund is founded by longtime investors Managing Partners Paul Sheng and Eric Bielke.

"We believe recent technological advances have accelerated the pace of scientific discovery, increasing the pool of technology companies that can produce venture-scale returns," Sheng says in a news release.

According to the fund, it hopes to bridge the gap for early stage capital for physical innovations and "moonshot" projects.

“What’s lacking in venture is rigorous technical diligence at the early stages and a playbook to scale these innovations at the pace necessary to lead industries," Bielke adds. "With this launch, we are looking forward to supporting founders with some of the most disruptive and novel ideas.”

The founder duo will bring each of the career expertise to their future portfolio companies. Sheng spent decades at McKinsey & Co and was the firm's head of the Global Energy & Materials practice. Bielke is a former director at Temasek’s Emerging Technologies Fund.

Houston is the 4th best U.S. city for Black professionals, report finds

Black History Month

In acknowledgement of Black History Month 2024, a new report compiled by Black employees at online rental marketplace Apartment List has ranked Houston the No. 4 best U.S. city for Black professionals.

Apartment List reviewed 76 cities across four major categories to determine the rankings: community and representation; economic opportunity; housing opportunity; and business environment.

Houston earned a score of 63.01 out of a total 100 points, making it the second-highest-ranked city in Texas for Black professionals, behind San Antonio (No. 3).

The city earned top-10 rankings in three out of the four main categories:

  • No. 3 – Business environment
  • No. 4 – Community and representation
  • No. 10 – Economic opportunity
  • No. 21 – Housing opportunity

Houston is commended for its strong Black business environment and economy, but there is some room for improvement when it comes to housing. Similarly to Apartment List's 2022 report – which also placed Houston at No. 4 – a little less than half (44 percent) of all Black Houston households are spending over 30 percent of their income on housing, which has increased two percent since 2019.

Houston has a larger Black population than San Antonio, at 19 percent, but its Black population share is overall lower than other cities in the top 10.

"Furthermore, the community is well-represented in some critical occupations: 20 percent of teachers are Black, as are 21 percent of doctors," the report said. "Houston is also home to the HBCU Texas Southern University, helping a job market when the median Black income is several thousand dollars above average."

Houston also has the highest rate of Black-owned businesses in the entire state, at 18 percent.

"From the Mitochondria Gallery to Ten Skyncare and Wisdom’s Vegan Bakery, Houston has it all!" the report said.

Here's how Houston stacked up in other metrics:

  • Black homeownership: 42 percent
  • Black lawyers: 14 percent
  • Black managers: 14 percent

Elsewhere in Texas
Texas cities dominated the overall top 10. San Antonio ranked just above Houston, with Dallas (No. 6) and Austin (No. 7) not too far behind.

San Antonio came in less than 2.5 points ahead of Houston with a total score of 65.44 points. The report praised San Antonio's scores across its economic opportunity (No. 2), housing opportunity (No. 7), and community and representation (No. 10). The city ranked No. 20 for its Black business environment.

But like Houston, San Antonio also fell behind in its Black homeownership rates, according to the study.

"While the Black homeownership rate is higher than average at 44 percent, the homeownership gap (Black homeownership rate - non-Black homeownership rate) quite low at -19 percent," the report's author wrote. "Perhaps this could be explained by San Antonio’s overall homeownership rate, which is also lower than the state’s average. Additionally, the lower homeownership gap could explain the cost burden rate also being lower than average at 41 percent."

The top 10 cities for Black professionals are:

  • No. 1 – Washington, D.C.
  • No. 2 – Atlanta, Georgia
  • No. 3 – San Antonio, Texas
  • No. 4 – Houston, Texas
  • No. 5 – Palm Bay, Florida
  • No. 6 – Dallas, Texas
  • No. 7 – Austin, Texas
  • No. 8 – Colorado Springs, Colorado
  • No. 9 – Lakeland, Florida
  • No. 10 – Charlotte, North Carolina
The full report and its methodology can be found on apartmentlist.com.

------

This article originally ran on CultureMap.

Houston expert: Can Houston replicate and surpass the success of Silicon Valley?

guest column

Anyone who knows me knows, as a Houston Startup Founder, I often muse about the still developing potential for startups in Houston, especially considering the amount of industry here, subject matter expertise, capital, and size.

For example, Houston is No. 2 in the country for Fortune 500 Companies — with 26 Bayou City companies on the list — behind only NYC, which has 47 ranked corporations, according to Fortune.

Considering layoffs, fund closings, and down rounds, things aren’t all that peachy in San Francisco for the first time in a long time, and despite being a Berkeley native, I’m rooting for Houston now that I’m a transplant.

Let’s start by looking at some stats.

While we’re not No. 1 in all areas, I believe we have the building blocks to be a major player in startups, and in tech (and not just energy and space tech). How? If the best predictor of future success is history, why not use the template of the GOAT of all startup cities: San Francisco and YCombinator. Sorry fellow founders – you’ve heard me talk about this repeatedly.

YCombinator is considered the GOAT of Startup Accelerators/Incubators based on:

  1. The Startup success rate: I’ve heard it’s as high as 75 percent (vs. the national average of 5 to 10 percent) Arc Search says 50 percent of YC Co’s fail within 12 years – not shabby.
  2. Their startup-to-unicorn ratio: 5 to 7 percent of YC startups become unicorns depending on the source — according to an Arc Search search (if you haven’t tried Arc Search do – super cool).
  3. Their network.

YC also parlayed that success into a "YC Startup School" offering:

  1. Free weekly lessons by YC partners — sometimes featuring unicorn alumni
  2. A document and video Library (YC SAFE, etc)
  3. Startup perks for students (AWS cloud credits, etc.)
  4. YC co-founder matching to help founders meet co-founders

Finally, there’s the over $80 billion in returns, according to Arc search, they’ve generated since their 2005 inception with a total of 4,000 companies in their portfolio at over $600 billion in value. So GOAT? Well just for perspective there were a jaw-dropping 18,000 startups in startup school the year I participated – so GOAT indeed.

So how do they do it? Based on anecdotal evidence, their winning formula is said to be the following well-oiled process:

  1. Bring over 282 startups (the number in last cohort) to San Francisco for 90 days to prototype, refine the product, and land on the go-to-market strategy. This includes a pre-seed YC SAFE investment of a phased $500,000 commitment for a fixed min 7 percent of equity, plus more equity at the next round’s valuation, according to YC.
  2. Over 50 percent of the latest cohort were idea stage and heavily AI focused.
  3. Traction day: inter-portfolio traction the company. YC has over 4,000 portfolio companies who can and do sign up for each other’s companies products because “they’re told to."
  4. Get beta testers and test from YC portfolio companies and YC network.
  5. If they see the traction scales to a massively scalable business, they lead the seed round and get this: schedule and attend the VC meetings with the founders.
  6. They create a "fear of missing out" mentality on Sand Hill Road as they casually mention who they’re meeting with next.
  7. They block competitors in the sector by getting the top VC’s to co-invest with then in the seed so competitors are locked out of the A list VC funding market, who then are up against the most well-funded and buzzed about players in the space.

If what I've seen is true, within a six-month period a startup idea is prototyped, tested, pivoted, launched, tractioned, seeded, and juiced for scale with people who can ‘make’ the company all in their corner, if not already on their board.

So how on earth can Houston best this?

  1. We have a massive amount of businesses — around 200,000 — and people — an estimated 7.3 million and growing.
  2. We have capital in search of an identity beyond oil.
  3. Our Fortune 500 companies that are hiring consultants for things that startups here that can do for free, quicker, and for a fraction of the extended cost.
  4. We have a growing base of tech talent for potential machine learning and artificial intelligence talent
  5. A sudden shot at the increasingly laid off big tech engineers.
  6. We have more accelerators and incubators.

What do we need to pull it off?

  1. An organized well-oiled YC-like process
  2. An inter-Houston traction process
  3. An "Adopt a Startup" program where local companies are willing to beta test and iterate with emerging startup products
  4. We have more accelerators but the cohorts are small — average five to 10 per cohort.
  5. Strategic pre-seed funding, possibly with corporate partners (who can make the company by being a client) and who de-risk the investment.
  6. Companies here to use Houston startup’s products first when they’re launched.
  7. A forum to match companies’ projects or labs groups etc., to startups who can solve them.
  8. A process in place to pull all these pieces together in an organized, structured sequence.

There is one thing missing in the list: there has to be an entity or a person who wants to make this happen. Someone who sees all the pieces, and has the desire, energy and clout to make it happen; and we all know this is the hardest part. And so for now, our hopes of besting YC may be up in the air as well.

------

Jo Clark is the founder of Circle.ooo, a Houston-based tech startup that's streamlining events management.