Academics have learned quickly that investigations based on data from online research agencies can have problems. Here are those problems and alternatives, according to Rice University researchers. Photo via Getty Images

Academics are learning quickly that investigations based on data from online research agencies have their drawbacks. Thousands of such studies are released every year – and if the data is compromised, so too are the studies themselves.

So it’s natural for researchers, and the managers who rely on their findings, to be concerned about potential problems with the samples they’re studying. Among them: participants who aren’t in the lab and researchers who can’t see who is taking their survey, what they are doing while answering questions or even if they are who they claim to be online. In the wake of a 2018 media piece about Amazon’s Mechanical Turks Service, “Bots on Amazon’s MTurk Are Ruining Psychology Studies,” one psychology professor even mused, “I wonder if this is the end of MTurk research?” (It wasn’t).

To tackle this problem, Rice Business professor Mikki Hebl joined colleagues Carlos Moreno and Christy Nittrouer of Rice University along with several other colleagues to highlight the value of other research methods. Four alternatives – field experiments, archival data, observations and big data – represent smart alternatives to overreliance on online surveys. These methods also have the advantage of challenging academics to venture outside of their laboratories and examine real people and real data in the real world.

Field experiments have been around for decades. But their value is hard to overestimate. Unlike online studies, field experiments enhance the role of context, especially in settings that are largely uncontrolled. It’s hard to fake a field experiment in order to create positive results since each one costs a considerable time and money.

And field experiments can yield real-life results with remarkable implications for society at large. Consider one experiment among 56 middle schools in New Jersey, which found that spreading anti-conflict norms was hugely successful in reducing the need for disciplinary action. Such studies have an impact well beyond what could be achieved with a simple online survey.

The best way to get started with a good field experiment, Hebl and her colleagues wrote, is for researchers to think about natural field settings to which they have access, either personally or by leveraging their networks. Then, researchers should think about starting with the variables critical for any given setting and which they would most like to manipulate to observe the outcome. When choosing variables, it’s helpful to start by thinking about what variable might have conditions leading to the greatest degree of behavior change if introduced into the setting.

Archival data is another excellent way to work around the limitations of online surveys, the researchers argue. These data get around some of the critical drawbacks of field research, including problems around how findings apply in a more general way. Archival data, especially in the form of state or national level data sets, provide information and insight into a large, diverse set of samples that are more representative of the general population than online studies.

Archival data can also help answer questions that are either longitudinal or multilevel in nature, which can be particularly tricky or even impossible to capture with data collected by any single research team. As people spend increasing amounts of time on social media, the internet also serves as a source of newer forms of archival data that can lend unique insights into individuals’ thoughts, attitudes, and behaviors over time.

With every passing year, technology becomes increasingly robust and adept at collecting massive amounts of data on an endless variety of human behavior. For the scientists who research social and personality psychology, the term “big data” refers not only to very large sets of data but also to the tools and techniques that are used to analyze it. The three defining properties of Big Data in this context include the speed of data processing and collection, the vast amount of data being analyzed and the sheer variety of data available.

By using big data, social scientists can generate research based on various conditions, as well as collect data in natural settings. Big data also offers the opportunity to consolidate information from huge and highly diverse stores of data. This technology has many applications, including psychological assessments and improving security in airports and other transportation hubs. In future research, Hebl and her team noted, researchers will likely leverage big data and its applications to detect our unconscious emotions.

Big data, archival information and field studies can all be used in conjunction with each other to maximize the fidelity of research. But researchers shouldn’t forget even more old-fashioned techniques, including the oldest: keen observation. With observation, there are often very few, if any, manipulations and the goal is simply to systematically record the way people behave.

Researchers – and the managers who make decisions based on their findings – should consider the advantages of old-style, often underused methodologies, Hebl and her colleagues argue. Moving beyond the college laboratory and digital data survey-collection platforms and into the real world offers some unparalleled advantages to science. For the managers whose stock prices may hinge on this science, it’s worth knowing – and understanding – how your all-important data was gathered.

------

This article originally ran on Rice Business Wisdom and is based on research from Mikki Hebl, the Martha and Henry Malcolm Lovett Professor of psychology at Rice University, and Carlos Moreno and Christy Nittrouer, who are graduate students at Rice University. Additional researchers include Ho Kwan Cheung, Eden B. King, and Hannah Markellis of George Mason University.

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Woodlands startup Mavria raises $130M to mass-produce AI data centers

seed funding

The Woodlands-based Mavria, which mass-produces factory-built modular AI data centers, just emerged from stealth mode with $130 million in funding at a $1 billion valuation.

Mavria raised the money in pre-seed and seed rounds led by Paradigm, an investment firm that concentrates on early-stage startups developing “pioneer” technology. Participants in the funding rounds include AMP PBC, Critical Frontier, Dream Ventures and Liquid 2 Ventures, co-founded by former NFL quarterback Joe Montana.

The company’s inaugural product, Terrain, is a prefabricated data center designed for AI labs, cloud computing providers and data center developers. Mavria says its platform avoids ground-up construction, delivering infrastructure more quickly and at a lower cost.

Mavria tells the Wall Street Journal that the first Terrain unit is being built at a Houston-area factory. The 5-megawatt Terrain system features power distribution, direct liquid cooling, controls and server racks.

“America sets the pace at the intelligence frontier. But the race is moving from the lab into the physical world,” Adam Blake, co-founder and CEO of Mavria, wrote in a blog post.

“Intelligence needs data centers. Data centers need power. Power needs factories, equipment, supply chains, and skilled workers, but much of that infrastructure is still built one custom project at a time, on timelines measured in years.”

Blake and Mavria’s two other co-founders, Nick Poradek and Seth Cohen, most recently worked at the U.S. Department of Energy. There, they focused on reforming the nuclear power sector.

From start to finish, it can take roughly three to six years to build a data center at an estimated cost of $10 million to $37 million per megawatt. Based on those figures, a 100-megawatt data center might cost as much as $3.7 billion.

Here are brief bios of Blake, Poradek and Cohen, who co-founded Mavria in May.

Adam Blake

Blake most recently was a senior advisor to U.S. Energy Secretary Chris Wright. He is co-founder and former CEO of Zego, a provider of energy management technology for property managers. Zego spun out from Brightergy, a commercial solar company. Blake is founder and former CEO of Brightergy.

Nick Poradek

Poradek, chief operating officer at Mavria, was also an advisor to the U.S. energy secretary. He is founder and former CEO of Spring-based Edera Energy, co-founder of The Woodlands-based craft-ice brand Clarity Ice, and founder and former CEO of The Woodlands-based Edera Capital. Poradek sold Edera Energy, a manufacturer of oilfield equipment, to Liberty Energy, a fracking company. Wright is Liberty’s founder and former chairman and CEO.

Seth Cohen

Cohen, chief strategy officer and chief legal officer at Mavria, was head of nuclear law and policy at the Department of Energy. He is also a former NASA advisor and a former attorney at Kirkland & Ellis.

“We believe in rapidly deploying infrastructure as a product, rather than custom-building every project,” Blake said. “We’re bringing together engineering, manufacturing, supply chains and capital so that every project makes us better at delivering the next.”

Meet the 40+ finalists for the 2026 Houston Innovation Awards

The Top Startups

Editor's note: We are just days away from unveiling the winners of the 2026 Houston Innovation Awards. Before the big reveal, we've compiled all of the coverage of this year's finalists. Get to know the 40+ finalists for nine awards categories below, then stay tuned to InnovationMap.com, where we'll announce the winners on Wednesday, November 18.

Minority-founded Business Finalists 

Our Minority-founded Businesses category honors innovative Houston startups founded or co-founded by BIPOC or LGBTQ+ representation. Five minority-founded businesses have been named finalists for the 2026 award. The finalists range from an AI edtech startup to a company operating in the floating offshore energy infrastructure sector.

They are: AI Made Fun, Deep Anchor Solutions, HEXASpec, Prana Surgical, and Torres Orbital Mining Inc. Read more.

Female-founded Business Finalists

Houston is home to many standout female founders, making inroads and breakthroughs in every industry. Our Female-founded Business category honors women-led startups that are shaping Houston innovation. Five female-founded businesses have been named finalists for the 2026 award. The finalists range from an AI startup for C-Suite execs to a company developing semi-autonomous crawler robots for corrosion detection.

They are: Adair, ARIX Technologies, Bairitone Health, FlowCellutions, and ParaDocs Health. Read more.

Health Tech Business Finalists

Houston has been driving medical innovation for decades and the local healthcare ecosystem continues to improve how patients are diagnosed, treated and cared for. The Health Tech Business category in our 2026 Houston Innovation Awards honors innovative startups within the health and medical technology sectors. Four forward-thinking businesses have been named finalists for the 2026 award. This year's finalists range from a startup developing miniaturized medical technologies for space to a company using AI to help develop cancer treatment plans.

They are: Bairitone Health, InformAI Inc., Prana Surgical, and Skybound MedTech. Read more.

Deep Tech Business Finalists

Houston has long been at the forefront of innovation, from NASA’s Johnson Space Center to its startup ecosystem using technology to disrupt industries. Our Deep Tech Business category honors innovative startups providing technology solutions based on substantial scientific or engineering challenges, including those in the AI, robotics and space sectors. Five deep tech companies have been named finalists for the 2026 award.

They are: Casimir, FocisAI, Machine Saver Inc., Square Robot, and Venus Aerospace. Read more.

Energy Transition Business Finalists

Houston is home to a growing number of startups reshaping what it means to be called the "Energy Capital of the World." Our Energy Transition Business category honors those innovative startups that are providing solutions within renewables, climatetech, clean energy, alternative materials, circular economy, and more. Five clean energy startups have been named finalists for the 2026 award. The finalists range from a lower-emission steel producer to a diagnostics platform developer working to support batteries used in data centers.

They are: Capwell Services, FlowCellutions, Hertha Metals, Mars Materials, and Solidec. Read more.

Scaleup of the Year Finalists

From IPOs to groundbreakings, some of Houston's most innovative companies reached major milestones this year. Our Scaleup of the Year category honors innovative later-stage startups that have recently reached a significant milestone in company growth. Three scaleups have been named finalists for the 2026 award.

They are: Erock, Hertha Metals, and Venus Aerospace. Read more.

Incubator/Accelerator of the Year Finalists

It takes a village to launch a business. That's where Houston's network of incubators and accelerators can step in, providing the resources, mentorship and community needed to push a fledgling company forward. Our Incubator/Accelerator of the Year category honors local organizations that are championing and fueling the growth of Houston startups. Three incubators and accelerators have been named finalists for the 2026 award. They support startups ranging from hard-tech companies to food and youth concepts.

They are: Activate, Impact Hub Houston, and MarMo Innovation. Read more.

Startup of the Year Finalists

Seven exceptional finalists are in the running for the title of Startup of the Year, which is our people's choice award in the annual Houston Innovation Awards. From innovative platforms benefiting the education, commerce, health, investment and IT sectors to next-gen memory technology and improvements for robotic supply chains, these startups are making an impact in Houston and beyond.

The finalists are: Fluxworks, IronLattice, Lumino, Progress Report, Rosarium Health, TokenRoster, and Thread. Read more.

Mentor of the Year Finalists

Houston’s thriving startup ecosystem is supported by a network of experienced leaders who work behind the scenes, investing their time and knowledge to help the next generation of entrepreneurs succeed. Our Mentor of the Year category honors those who dedicate their time and expertise to guide and support budding entrepreneurs. Six individuals have been named finalists for the 2026 award. They support promising startups in the medical tech, digital health, clean energy, hardware sectors and more.

They are: Al Danto, Rice University; Eric Rubenstein, New Climate Ventures; Jeremy Pitts, Activate; Joe Alapat, Liongard; Kyle Judah, Rice University's Liu Idea Lab for Innovation & Entrepreneurship; Rachel Bickham, Bickham Services Unlimited LLC. Read more.