HOUSTON VOICES

University of Houston: Here's what intuitive AI and ChatGPT mean for research

Here's how AI-based chat will effect research. Graphic byMiguel Tovar/University of Houston

Researchers have to write extremely specific papers that require higher-order thinking — will an intuitive AI program like OpenAI’s ChatGPT be able to imitate the vocabulary, grammar and most importantly, content, that a scientist or researcher would want to publish? And should it be able to?

University of Houston’s Executive Director of the Research Integrity and Oversight (RIO) Office, Kirstin Holzschuh, puts it this way: “Scientists are out-of-the box thinkers – which is why they are so important to advancements in so many areas. ChatGPT, even with improved filters or as it continues to evolve, will never be able to replace the critical and creative thinking we need in these disciplines.”

“A toy, not a tool”

The Atlantic published, “ChatGPT Is Dumber Than You Think,” with a subtitle advising readers to “Treat it like a toy, not a tool.” The author, Ian Bogost, indulged in the already tired troupe of asking ChatGPT to write about “ChatGPT in the style of Ian Bogost.” The unimaginative but overall passable introduction to his article was proof that, “any responses it generates are likely to be shallow and lacking in depth and insight.”

Bogost expressed qualms similar to those of Ezra Klein, the podcaster behind, “A Skeptical Take on the AI Revolution.” Klein and his guest, NYU psychology and neural science professor Gary Marcus, mostly questioned the reliability and truthfulness of the chatbot. Marcus calls the synthesizing of its databases and the “original” text it produces nothing more than “cut and paste” and “pastiche.” The algorithm used by the program has been likened to auto-completion, as well.

However, practical use cases are increasingly emerging, which blur the lines between technological novelty and professional utility. Whether writing working programming code or spitting out a rough draft of an essay, ChatGPT does have a formidable array of competencies. Even if just how competent it is remains to be seen. All this means that as researchers look for efficiencies in their work, ChatGPT and other AI tools will become increasingly appealing as they mature.

Pseudo-science and reproducibility

The Big Idea reached out to experts across the country to determine what might be the most pressing problems and what might be potential successes for research now that ChatGPT is readily accessible.

Holzschuh, stated that there are potential uses, but also potential misuses of ChatGPT in research: “AI’s usefulness in compiling research proposals or manuscripts is currently limited by the strength of its ability to differentiate true science from pseudo-science. From where does the bot pull its conclusions – peer-reviewed journals or internet ‘science’ with no basis in reproducibility?” It’s “likely a combination of both,” she says. Without clear attribution, ChatGPT is problematic as an information source.

Camille Nebeker is the Director of Research Ethics at University of California, San Diego, and a professor who specializes in human research ethics applied to emerging technologies. Nebeker agrees that because there is no way of citing the original sources that the chatbot is trained on, researchers need to be cautious about accepting the results it produces. That said, ChatGPT could help to avoid self-plagiarism, which could be a benefit to researchers. “With any use of technologies in research, whether they be chatbots or social media platforms or wearable sensors, researchers need to be aware of both the benefits and risks.”

Nebeker’s research team at UC San Diego is conducting research to examine the ethical, legal and social implications of digital health research, including studies that are using machine learning and artificial intelligence to advance human health and wellbeing.

Co-authorship

The conventional wisdom in academia is “when in doubt, cite your source.” ChatGPT even provides some language authors can use when acknowledging their use of the tool in their work: “The author generated this text in part with GPT-3, OpenAI’s large-scale language-generation model. Upon generating draft language, the author reviewed, edited, and revised the language to their own liking and takes ultimate responsibility for the content of this publication.” A short catchall statement in your paper will likely not pass muster.

Even when being as transparent as possible about how AI might be used in the course of research or in development of a manuscript, the question of authorship is still fraught. Holden Thorp, editor-in-chief of the Science, writes in Nature, that “we would not allow AI to be listed as an author on a paper we published, and use of AI-generated text without proper citation could be considered plagiarism.” Thorp went on to say that a co-author of an experiment must both consent to being a co-author and take responsibility for a study. “It’s really that second part on which the idea of giving an AI tool co-authorship really hits a roadblock,” Thorp said.

Informed consent

On NBC News, Camille Nebeker stated that she was concerned there was no informed consent given by the participants of a study that evaluated the use of a ChatGPT to support responses given to people using Koko, a mental health wellness program. ChatGPT wrote responses either in whole or in part to the participants seeking advice. “Informed consent is incredibly important for traditional research,” she said. If the company is not receiving federal money for the research, there isn’t requirement to obtain informed consent. “[Consent] is a cornerstone of ethical practices, but when you don’t have the requirement to do that, people could be involved in research without their consent, and that may compromise public trust in research.”

Nebeker went on to say that study information that is conveyed to a prospective research participant via the informed consent process may be improved with ChatGPT. For instance, understanding complex study information could be a barrier to informed consent and make voluntary participation in research more challenging. Research projects involve high-level vocabulary and comprehension, but informed consent is not valid if the participant can’t understand the risks, etc. “There is readability software, but it only rates the grade-level of the narrative, it does not rewrite any text for you,” Nebeker said. She believes that one could input an informed consent communication into ChatGPT and ask for it to be rewritten at a sixth to eighth grade level (which is the range that Institutional Review Boards prefer.)

Can it be used equitably?

Faculty from the Stanford Accelerator for Learning, like Victor Lee, are already strategizing ways for intuitive AI to be used. Says Lee, “We need the use of this technology to be ethical, equitable, and accountable.”

Stanford’s approach will involve scheduling listening sessions and other opportunities to gather expertise directly from educators as to how to strike an effective balance between the use of these innovative technologies and its academic mission.

The Big Idea

Perhaps to sum it up best, Holzschuh concluded her take on the matter with this thought: “I believe we must proceed with significant caution in any but the most basic endeavors related to research proposals and manuscripts at this point until bot filters significantly mature.”

------

This article originally appeared on the University of Houston's The Big Idea. Sarah Hill, the author of this piece, is the communications manager for the UH Division of Research.

Trending News

Building Houston

 
 

Check out this curated list of innovation events in Houston for April. Photo via Getty Images

It's time to look at what's on the agenda for April for Houston innovators — from pitch competitions to networking events.

Here's a roundup of events not to miss this month. Mark your calendars and register accordingly.

Note: This post might be updated to add more events.

April 4 — A.I. Digital and the Future of Energy

In the latest installment of UH Energy's "Critical Issues in Energy" Symposium Series, the speakers will take a deeper dive into the role of A.l. within the energy marketplace, specifically with what is being done with A.I. and what is capable of being done. In addition to this pivotal look at one crucial aspect of the energy transition, attendees will be afforded networking opportunities with speakers and distinguished guests, and food/refreshments will be provided.

The event is Tuesday, April 4, from 5:30 to 7:30 pm, at the University of Houston. Click here to register.

April 5 — Creating & Sustaining Innovation & Entrepreneurship

Join us for a fireside chat discussing the growth of entrepreneurship & a panel on demystifying the patent process.

The event is Wednesday, April 5, from 9 to 11:30 am, at the Ion. Click here to register.

April 5 — HAN Angel Academy

Learn angel investing best practices from Capital Factory co-founder and chairman, Gordon Daugherty in a half-day bootcamp format for accredited investors.

The event is Wednesday, April 5, from 11 am to 4 pm, at Rice University - Shell Auditorium. Click here to register.

April 11 — Future of Health Care

The Greater Houston Partnership's inaugural Future of Health Care event highlights one of the region's major industry sectors driven by world-class institutions and professional talent.

The event is Wednesday, April 11, from 10:30 am to 1:30 pm, at the Royal Sonesta. Click here to register.

April 11 — Idea to Impact: Navigating the Challenges to Commercializing University Discoveries

Amazing discoveries are made in university labs every day, yet most of them never develop into widely accessible commercial products. Why? And what can universities do to change that? As part of Rice University's "Betterment of the World" Scientia Lecture Series, join Rice Business on April 11 at 4 pm virtually or in person (Shell Auditorium, McNair Hall) to hear Yael Hochberg, Professor in Entrepreneurship at the Jones Graduate School of Business, as she discusses the challenges in commercializing university research discoveries.

The event is Wednesday, April 11, from 4 to 5 pm, at Rice University and online. Click here to register.

April 11 — Greentown Houston Climatetech Career Fair 2023

Greentown Labs and ALLY Energy welcomes all professionals, students, and soon-to-be graduates to join us for the Greentown Houston Career Fair, which focuses on connecting professionals directly with Greentown Houston’ network of founders, CEOs, and cutting-edge climatetech startups looking for bright and eager talent.

The event is Tuesday, April 11, from 4:30 to 6:30 pm, at Greentown Houston. Click here to register.

April 15 — Earth Day Clothing Swap Party with Sustainable Fashion & Earth Month HTX

A clothing swap is a fun, alternative solution to thrift shopping or secondhand fashion that allows you to clean out the clothes you no longer wear and in return bring home new additions to your closet - all for free and hosted by Houston startup RESTATEMENT.

The event is Saturday, April 15, from noon to 5 pm, at Patterson Park. Click here to register.

April 17-18 — AI Powered Renewable Energy Workshop

AI Houston Institute of Rice University in partnership with Ion is getting together experts from academia and industry working on the application of artificial intelligence in solving some of the most complex challenges facing the Energy industry as it transitions into alternative sources of energy that are green and sustainable.

The event is Monday, April 17, to Tuesday, April 18, at the Ion. Click here to register.

April 19 — Investor Studio Series: Dream Big Ventures x Ion x Mendoza Ventures

Underrepresented founders face a lot of barriers, including rarely seeing VC dollars. However, Dream Big Ventures and Mendoza Ventures are looking to change those statistics to help diverse founders succeed. Join Dream Big Ventures Founder and CEO Staci LaToison, and Mendoza Ventures Co-Founders Senofer Mendoza and Adrian Mendoza, as they discuss the growth of women and Latinas in Fintech, AI, and Cybersecurity in this fireside chat.

The event is Wednesday, April 19, from 5 to 7 pm, at the Ion. Click here to register.

April 19 — The H. Albert Napier Rice Launch Challenge Championships

Join Liu Idea Lab for Innovation and Entrepreneurship and support Rice University student ventures at the H. Albert Napier Rice Launch Challenge (NRLC) Championships on Wednesday, April 19. Five student finalists will pitch their ventures to compete for the chance to win a share of $100,000 in equity-free funding.

The event is Wednesday, April 19, from 5:30 to 9 pm, at Rice University. Click here to register.

April 20 — Female Founders and Funders

Calling all rockstar female founders and investors in the Houston area. Mark your calendars for this month's Female Founders and Funders meetup. Coffee and breakfast is provided and the event is free to attend.

The event is Thursday, April 20, from 9 to 10 am, at Sesh Coworking. Click here to register.

Trending News