Academics have learned quickly that investigations based on data from online research agencies can have problems. Here are those problems and alternatives, according to Rice University researchers. Photo via Getty Images

Academics are learning quickly that investigations based on data from online research agencies have their drawbacks. Thousands of such studies are released every year – and if the data is compromised, so too are the studies themselves.

So it’s natural for researchers, and the managers who rely on their findings, to be concerned about potential problems with the samples they’re studying. Among them: participants who aren’t in the lab and researchers who can’t see who is taking their survey, what they are doing while answering questions or even if they are who they claim to be online. In the wake of a 2018 media piece about Amazon’s Mechanical Turks Service, “Bots on Amazon’s MTurk Are Ruining Psychology Studies,” one psychology professor even mused, “I wonder if this is the end of MTurk research?” (It wasn’t).

To tackle this problem, Rice Business professor Mikki Hebl joined colleagues Carlos Moreno and Christy Nittrouer of Rice University along with several other colleagues to highlight the value of other research methods. Four alternatives – field experiments, archival data, observations and big data – represent smart alternatives to overreliance on online surveys. These methods also have the advantage of challenging academics to venture outside of their laboratories and examine real people and real data in the real world.

Field experiments have been around for decades. But their value is hard to overestimate. Unlike online studies, field experiments enhance the role of context, especially in settings that are largely uncontrolled. It’s hard to fake a field experiment in order to create positive results since each one costs a considerable time and money.

And field experiments can yield real-life results with remarkable implications for society at large. Consider one experiment among 56 middle schools in New Jersey, which found that spreading anti-conflict norms was hugely successful in reducing the need for disciplinary action. Such studies have an impact well beyond what could be achieved with a simple online survey.

The best way to get started with a good field experiment, Hebl and her colleagues wrote, is for researchers to think about natural field settings to which they have access, either personally or by leveraging their networks. Then, researchers should think about starting with the variables critical for any given setting and which they would most like to manipulate to observe the outcome. When choosing variables, it’s helpful to start by thinking about what variable might have conditions leading to the greatest degree of behavior change if introduced into the setting.

Archival data is another excellent way to work around the limitations of online surveys, the researchers argue. These data get around some of the critical drawbacks of field research, including problems around how findings apply in a more general way. Archival data, especially in the form of state or national level data sets, provide information and insight into a large, diverse set of samples that are more representative of the general population than online studies.

Archival data can also help answer questions that are either longitudinal or multilevel in nature, which can be particularly tricky or even impossible to capture with data collected by any single research team. As people spend increasing amounts of time on social media, the internet also serves as a source of newer forms of archival data that can lend unique insights into individuals’ thoughts, attitudes, and behaviors over time.

With every passing year, technology becomes increasingly robust and adept at collecting massive amounts of data on an endless variety of human behavior. For the scientists who research social and personality psychology, the term “big data” refers not only to very large sets of data but also to the tools and techniques that are used to analyze it. The three defining properties of Big Data in this context include the speed of data processing and collection, the vast amount of data being analyzed and the sheer variety of data available.

By using big data, social scientists can generate research based on various conditions, as well as collect data in natural settings. Big data also offers the opportunity to consolidate information from huge and highly diverse stores of data. This technology has many applications, including psychological assessments and improving security in airports and other transportation hubs. In future research, Hebl and her team noted, researchers will likely leverage big data and its applications to detect our unconscious emotions.

Big data, archival information and field studies can all be used in conjunction with each other to maximize the fidelity of research. But researchers shouldn’t forget even more old-fashioned techniques, including the oldest: keen observation. With observation, there are often very few, if any, manipulations and the goal is simply to systematically record the way people behave.

Researchers – and the managers who make decisions based on their findings – should consider the advantages of old-style, often underused methodologies, Hebl and her colleagues argue. Moving beyond the college laboratory and digital data survey-collection platforms and into the real world offers some unparalleled advantages to science. For the managers whose stock prices may hinge on this science, it’s worth knowing – and understanding – how your all-important data was gathered.

------

This article originally ran on Rice Business Wisdom and is based on research from Mikki Hebl, the Martha and Henry Malcolm Lovett Professor of psychology at Rice University, and Carlos Moreno and Christy Nittrouer, who are graduate students at Rice University. Additional researchers include Ho Kwan Cheung, Eden B. King, and Hannah Markellis of George Mason University.

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

MD Anderson receives $10M gift to launch pancreatic cancer program

med funding

The University of Texas MD Anderson Cancer Center will be getting a significant boost in the fight against pancreatic cancer thanks to a recent gift from longtime supporters Zelma and William Reid. The medical system announced this month that a $10 million donation would help it establish a new Pancreatic Cancer High-Risk Interception Program.

“Philanthropic investments like this create opportunities to accelerate discoveries and pursue bold approaches to some of the most challenging cancers we face,” said Dr. Jeffrey E. Lee, president ad interim of UT MD Anderson, said in a news release. “We are deeply grateful to Zelma and Bill Reid for their generosity and enduring commitment. Their support will help advance innovative research aimed at intercepting pancreatic cancer earlier, when we have the greatest opportunity to improve outcomes for patients.”

Pancreatic cancer is one of the most deadly types of cancer. Despite being relatively rare, it ranks third in total deaths from cancer in the United States. Less than 10 percent of patients diagnosed with pancreatic cancer are still alive five years later.

Dr. Florencia McAllister, William Reid, Dr. Michael P. Kim, Zelma Reid, Dr. Manoop S. Bhutani, and Dr. Matthew H.G. Katz. Photo courtesy MD Anderson

The problem is often detection. The pancreas is located deep in the upper abdomen among many other organs, which can make spotting tumors difficult. Some blood tests can indicate pancreatic cancer, but it is usually not diagnosed until it spreads.

The new Pancreatic Cancer High-Risk Interception Program hopes to assemble new diagnostic techniques and patient screening tools to increase early detection. MD Anderson’s Dr. Michael P. Kim, associate professor of surgical oncology; Dr. Manoop S. Bhutani, professor of gastroenterology and hepatology; and Dr. Florencia McAllister, professor of gastrointestinal medical oncology and genetics, will lead the new program.

The team will rely on advanced imaging, molecular diagnostics, AI-driven assessment, and DNA testing to both create an at-risk patient population profile and hopefully help detect the cancer in its earliest stages. For instance, some of these tools will be able to monitor pancreatic cysts without invasive surgery.

“The ultimate goal is to intercept pancreatic cancer development or to initiate treatment earlier in the disease process, when patients have the best chance for successful outcomes,” Kim added in the release. “This gift will allow us to expand our research efforts, strengthen collaborations across disciplines and accelerate promising strategies to identify and intercept pancreatic cancer before it becomes life-threatening. We are incredibly thankful to the Reids for making this work possible.”

Axiom Space inks partnership to grow semiconductor crystals in orbit

space deal

Down in Webster, Texas, and high above the Earth, Axiom Space and Kansas-based Nitride Global Inc. will grow the next generation of semiconductor crystals in microgravity thanks to a new memorandum of understanding (MOU) signed earlier this month.

“Signing this MOU with Nitride Global reflects the growing commercial interest in producing advanced semiconductor materials in space,” Lucie Low, chief science officer for Axiom Space, said in a news release. “Their leadership in aluminium nitride (AlN) crystal growth and advanced packaging technologies, combined with Axiom Space’s capabilities in orbital infrastructure and mission integration, position us to demonstrate real commercial value in low-Earth orbit (LEO).”

This latest partnership builds on existing collaboration between Axiom and NitrideGlobal and NASA Ames Research Center.

Aluminium nitride crystals are part of the cutting-edge generation of semiconductors essential to emerging high-voltage transistors and also used in various medical technologies. Because of their high thermal stability, they can be used in a variety of environments and applications that have revolutionized everything from electric cars to the grids the cars run on.

However, the crystals are challenging to grow on Earth and face defects and size limitations due to gravity. Growing them in space can enhance their performance, according to NitrideGlobal. Microgravity allows them to grow more uniformly and with fewer defects, potentially resulting in larger, purer and more reliable crystals.

That’s where Axiom Space comes in. The company is developing Axiom Station, a successor to the International Space Station, where new research and manufacturing can be carried out.

“This MOU marks a pivotal milestone in our close partnership with Axiom Space that started as part of the NASA Small Business Innovation Research (SBIR) for AlN growth in space and is now expanding to usher the development of an innovation ecosystem,” Mahyar Khosravi, CEO of Nitride Global Inc., added in the release. “With Axiom Space’s leadership in the in-space manufacturing sector, this partnership will aim to deliver a platform for commercially viable manufacturing of [ultrawide bandgap materials] that will enable the next generation of semiconductor & microelectronics for terrestrial and planetary exploration uses.”

Houston's IAH lands on list of 15 most expensive U.S. airports

Travel Woes

Hold on to those carry-on bags: George Bush Intercontinental Airport is checking in as one of the 15 most expensive airports in the U.S., a new study has revealed.

The analysis from digital commerce and marketing platform ConsumerVoice.org compared the average domestic flight costs at the 50 largest U.S. airports, ranking them from highest to lowest. Flight price data was sourced from the U.S. Department of Transportation’s Bureau of Transportation Statistics (BTS) during the first and second quarters of 2026 and compared with the same period in 2025.

Washington Dulles International Airport in Virginia tops the list as the priciest major airport in the U.S, with domestic flights at IAD costing $534.34 on average. Charlotte Douglas International Airport in North Carolina comes in second place with an average fare cost of $527.79.

IAH lands at No. 13 nationwide, and it's the second most expensive in Texas, the findings show. The typical domestic flight from IAH costs $482.02, and they aren't getting any cheaper. Flights out of IAH are nine percent more expensive than they were a year ago, the report found. The average domestic flight cost $37.80 less in 2025.

Houstonians not only need to be prepared to spend a little extra money when booking their tickets; they'll also need to pack their patience, as IAH also ranks among the worst airports for flight delays and cancellations.

Travelers on a budget can save more on flights out of William P. Hobby Airport, if they're willing to make the drive. Travelers can save about 13 percent on their flights by flying through HOU instead of IAH, but there are other costs to take into consideration.

"Ground transportation, gas, and parking can eat into the difference, so factor these in when choosing the most economical departure airport," the report said.

HOU ranked as the No. 31 most expensive airport on the list with domestic flights coming in at $417.78 on average. Average fares at HOU are also nine percent more expensive than they were last year.

The top 10 priciest major airports in the U.S. are:

  • No. 1 – Washington Dulles International Airport
  • No. 2 – Charlotte Douglas International Airport
  • No. 3 – Detroit metro Wayne County Airport
  • No. 4 – Salt Lake City International
  • No. 5 – Minneapolis-St. Paul International
  • No. 6 – San Francisco International
  • No. 7 – John F. Kennedy International
  • No. 8 – Newark Liberty International
  • No. 9 – Dallas/Fort Worth International
  • No. 10 – Hartsfield-Jackson Atlanta International
---

This article originally appeared on CultureMap.com.