Houston expert: Navigating dark data within research and innovation

houston voices

Let's talk about dark data — what it means and how to navigate it. Graphic by Miguel Tovar/University of Houston

Is it necessary to share ALL your data? Is transparency a good thing or does it make researchers “vulnerable,” as author Nathan Schneider suggests in the Chronicle of Higher Education article, “Why Researchers Shouldn’t Share All Their Data.”

Dark Data Defined

Dark data is defined as the universe of information an organization collects, processes and stores – oftentimes for compliance reasons. Dark data never makes it to the official publication part of the project. According to the Gartner Glossary, “storing and securing data typically incurs more expense (and sometimes greater risk) than value.”

This topic is reminiscent of the file drawer effect, a phenomenon which reflects the influence of the results of a study on whether or not the study is published. Negative results can be just as important as hypotheses that are proven.

Publication bias and the need to only publish positive research that supports the PI’s hypothesis, it can be argued, is not good science. According to an article in the Indian Journal of Anaesthesia, authors Priscilla Joys Nagarajan, et al., wrote: “It is speculated that every significant result in the published world has 19 non-significant counterparts in file drawers.” That’s one definition of dark data.

Total Transparency

But what to do with all your excess information that did not make it to publication, most likely because of various constraints? Should everything, meaning every little tidbit, be readily available to the research community?

Schneider doesn’t think it should be. In his article, he writes that he hides some findings in a paper notebook or behind a password, and he keeps interviews and transcripts offline altogether to protect his sources.

Open-source

Open-source software communities tend to regard total transparency as inherently good. What are the advantages of total transparency? You may make connections between projects that you wouldn’t have otherwise. You can easily reproduce a peer’s experiment. You can even become more meticulous in your note-taking and experimental methods since you know it’s not private information. Similarly, journalists will recognize this thought pattern as the recent, popular call to engage in “open journalism.” Essentially, an author’s entire writing and editing process can be recorded, step by step.

TMI

This trend has led researchers to open-source programs like Jupyter and GitHub. Open-source programs detail every change that occurs along a project’s timeline. Is unorganized, excessive amounts of unpublishable data really what transparency means? Or does it confuse those looking for meaningful research that is meticulously curated?

The Big Idea

And what about the “vulnerability” claim? Sharing every edit and every new direction taken opens a scientist up to scoffers and harassment, even. Dark data in industry even involves publishing salaries, which can feel unfair to underrepresented, marginalized populations.

In Model View Culture, Ellen Marie Dash wrote: “Let’s give safety and consent the absolute highest priority, with openness and transparency prioritized explicitly below those. This means digging deep, properly articulating in detail what problems you are trying to solve with openness and transparency, and handling them individually or in smaller groups.”

------

This article originally appeared on the University of Houston's The Big Idea. Sarah Hill, the author of this piece, is the communications manager for the UH Division of Research.

The winner of the contest will be announced at a Rockets game in early April. Courtesy of Greater Houston Convention and Visitors Bureau

BBVA Compass and the Houston Rockets team up to launch revamped startup contest

small biz Slam dunk

Houston startups have a chance at $10,000 thanks to the Houston Rockets and BBVA Compass' LaunchPad Contest. The application process begins on February 19 and concludes on March 5.

In its third installment, the contest is doing things a little differently this year. Previously, small businesses had to respond to questions about their organization and what they would do with the prize money. This year, with a special focus on startups, applicants are also being asked about using new technology to increase productivity.

"BBVA Compass is in a unique position and we want to leverage that to help elevate entrepreneurship through digital capabilities," says BBVA Compass Houston CEO Mark Montgomery in a release. "We are a leader in the financial industry's digital transformation, and have won multiple awards because of our innovative products and services in that realm. We want to create ample opportunities for a rising business through that industry-leading expertise. The Rockets are excellent teammates, and we are excited to unveil this new version of our collaborative contest with them."

Following the application process, BBVA and the Rockets will select four finalists before opening the contest up to fans to pick their favorite. The winner will then be announced at a game in early April. The winning company will receive, in addition to the $10,000, consultations with both BBVA and the Rockets executives.

"We are excited to partner with BBVA again for this annual contest," says Rockets Chief Revenue Officer Gretchen Sheirr in the release. "They have been best in class in their industry with their digital strategy, so it's fantastic that they will be providing an opportunity for other businesses to thrive in this space. We look forward to reviewing our fans' contest submissions and seeing the great work being done by startup businesses in our great city."

Last year's Launchpad winner was Buy On Purpose, according to a release. The office supply delivery company on the northside of town boasts same-day delivery and donates half its profits to organizations fighting human trafficking, clean water initiatives, and other causes.

Learn more about last year's winner here:

BBVA Compass and the Houston Rockets announce Buy On Purpose as its small business contest winnerwww.youtube.com

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Property Showcase

Intuitive Machines lands $180M NASA contract for lunar delivery mission

to the moon

NASA has awarded Intuitive Machines a $180.4 million Commercial Lunar Payload Services (CLPS) award to deliver science and technology to the moon.

This is the fifth CLPS award the Houston spacetech company has received from NASA, according to a release. It will be the first mission to utilize Intuitive Machines' larger cargo lunar lander, Nova-D.

Known as IM-5, the mission is expected to deliver seven payloads to Mons Malapert, a ridge near the Lunar South Pole, which is a "compelling location for future communications, navigation, and surface infrastructure," according to the release.

“We believe our space infrastructure provides the scalability and flexibility needed to support an increased cadence of new Artemis missions and advance national objectives. This CLPS award accelerates our expansion efforts as we build, connect, and operate the systems powering that infrastructure,” Steve Altemus, CEO of Intuitive Machines, said in the release. “We look forward to working closely with NASA to deliver mission success on IM-5 and to provide sustained operations and persistent connectivity in the cislunar environment and across the solar system.”

The delivery will include the Australian Space Agency’s lunar rover, known as Roo-ver, and another lunar rover from Honeybee Robotics, a part of Jeff Bezos' Blue Origin. Intuitive Machines will also deliver chemical analysis instruments, radiation detectors and other technologies, as well as a capsule named Sanctuary that shows examples of human achievements.

Intuitive Machines previously completed its IM-1 and IM-2 missions, which put the first commercial lunar lander on the moon and achieved the southernmost lunar landing, respectively.

Its IM-3 mission is expected to deliver international payloads to the moon's Reiner Gamma this year. It’s IM-4 mission, funded by a $116.9 million CLPS award, is expected to deliver six science and technology payloads to the Moon’s South Pole in 2027.

The company also announced a $175 million equity investment to fuel growth earlier this month.

TotalEnergies exits U.S. offshore wind sector in $1B federal deal

Energy News

TotalEnergies, a French company whose U.S. headquarters is in Houston, has agreed to redirect nearly $930 million in capital from two offshore wind leases on the East Coast to oil, natural gas and liquefied natural gas (LNG) production.

In its agreement with the U.S. Department of the Interior, TotalEnergies has also promised not to develop new offshore wind projects in the U.S. “in light of national security concerns,” according to a department press release.

Federal agency hails ‘landmark agreement’

The Department of the Interior called the deal a “landmark agreement” that will steer capital “from expensive, unreliable offshore wind leases toward affordable, reliable natural gas projects that will provide secure energy for hardworking Americans.”

Renewable energy advocates object to what they believe is the Trump administration’s mischaracterization of offshore wind projects.

Under the Department of the Interior agreement, the federal government will reimburse TotalEnergies on a dollar-for-dollar basis for the leases, up to the amount that the energy company paid.

“Offshore wind is one of the most expensive, unreliable, environmentally disruptive, and subsidy-dependent schemes ever forced on American ratepayers and taxpayers,” Interior Secretary Doug Burgum said in the announcement. “We welcome TotalEnergies’ commitment to developing projects that produce dependable, affordable power to lower Americans' monthly bills while providing secure U.S. baseload power today — and in the future.”

TotalEnergies cites U.S. policy in move away from U.S. wind power

In the news release, Patrick Pouyanné, chairman and CEO of TotalEnergies, says the company was “pleased” to sign the agreement to support the Trump administration’s energy policy.

“Considering that the development of offshore wind projects is not in the country’s interest, we have decided to renounce offshore wind development in the United States, in exchange for the reimbursement of the lease fees,” Pouyanné says.

TotalEnergies redirects capital to LNG, oil, and natural gas

TotalEnergies will use the $928 million it spent on the offshore wind leases for development of a joint venture LNG plant in the Rio Grande Valley, as well as for production of upstream oil in the Gulf of Mexico and for production of shale gas.

“These investments will contribute to supplying Europe with much-needed LNG from the U.S. and provide gas for U.S. data center development. We believe this is a more efficient use of capital in the United States,” Pouyanné says.

TotalEnergies paid $133.3 million for an offshore wind lease at the Carolina Long Bay project off the coast of North Carolina and $795 million in 2022 for a lease covering a 1,545-megawatt commercial offshore wind facility off the coast of New Jersey.

“TotalEnergies’ studies on these leases have shown that offshore wind developments in the United States, unlike those in Europe, are costly and might have a negative impact on power affordability for U.S. consumers,” TotalEnergies said in a company-issued press release. “Since other technologies are available to meet the growing demand for electricity in the United States in a more affordable way, TotalEnergies considers there is no need to allocate capital to this technology in the U.S.”

Since 2022, TotalEnergies has invested nearly $12 billion to promote the development of oil, LNG, and electricity in the U.S. In 2025, TotalEnergies was the No. 1 exporter of LNG from the U.S.

Industry groups push back on offshore wind pullback

The American Clean Energy Association has pushed back on the Trump administration’s characterization of offshore wind projects.

“The offshore wind industry creates thousands of high-quality, good-paying jobs, and is revitalizing American manufacturing supply chains and U.S. shipyards,” Jason Grumet, the association’s CEO, said in December after the Trump administration paused all leases for large-scale offshore wind projects under construction in the U.S. “It is a critical component of our energy security and provides stable, domestic power that helps meet demand and keep costs low.”

Grumet added that President Trump’s “relentless attacks on offshore wind undermine his own economic agenda and needlessly harm American workers and consumers.” He called for passage of federal legislation that would prevent the White House “from picking winners and losers” in the energy sector and “placing political ideology” above Americans’ best interests.

The National Resources Defense Council offered a similar response to the offshore wind leases being paused.

“In its ongoing effort to prop up waning fossil fuels interests, the administration is taking wilder and wilder swings at the clean energy projects this economy needs,” said Pasha Feinberg, the council’s offshore wind strategist. “Investments in energy infrastructure require business certainty. This is the opposite. If the administration thinks the chilling impacts of this action are limited to the clean energy sector, it is sorely mistaken.”

---

This article originally appeared on EnergyCapitalHTX.com.

Houston researcher examines how AI helps and hurts creativity

eye on ai

As artificial intelligence continues to grow and seeps into spaces like art, design and writing, a Houston researcher is examining its effects on creativity.

University of Houston’s Bauer College Assistant Professor Jinghui Hou, in collaboration with scholars around the world, recently published the paper "The Double-Edged Roles of Generative AI in the Creative Process" in the journal Information Systems Research.

Through the research, the team identified two stages of creativity that AI can influence: ideation and implementation.

In one study, Hou and her team developed a lab experiment to examine the impact of a cutting-edge generative AI tool during the brainstorming or ideation phase on a group of designers with varying levels of expertise.

The study showed that nearly all designers who used generative AI during this stage improved in the creativity of their graphic design work, and that the improvements were substantial and consistent across the board.

“In the first stage, we find that for anyone, including ordinary people and expert designers, AI is very helpful because of its computational power,” Hou said in a news release. “It can go beyond the imagination that humans have. For example, if I wanted to imagine a tiger with wings, it would be hard to see that in my head, but AI can do it easily.”

However, a second study examining the implementation stage found that AI affects professionals differently than novice designers.

The study showed that novice designers continued to improve in all aspects of their work when using AI. But more expert designers did not see significant improvements in the implementation stage. Rather, expert designers who used AI spent 57 percent more time completing their work compared with their peers who did not use AI.

“In the implementation stage, we find that AI is still very helpful for those ordinary people, but it creates more work for expert designers,” Hou said in the release. “This is because the designer has years of training to materialize a piece of artwork. We find that AI uses different techniques to produce creative work. For designers, it can become burdensome to revise what AI made.”

Hou’s paper suggests that AI is most helpful in the brainstorming stage, but hopes to see generative AI developers program tailor the technology for expert-level, professional needs.

“It could give users more freedom to fit the technology to their usage pattern and workflow,” Hou added. “In a sense, it's not about people catering to the AI, but the AI technology catering to people."

View All Listings