For years, the relentless drive to collect data as the foundation for nearly every decision at colleges and universities—and equally across every corner of our modern economy—has evolved into a national obsession. Gripped by the seemingly definitive results spreadsheets and predictive models produce, many observers find their conclusions sacrosanct and unquestioned, as if every algorithmic output and statistical metric is handed down by digital gods.

“Numbers don’t lie,” people routinely say, capturing a cultural faith in quantification that runs deep.

Yet, the foundations of this confidence are frequently built upon shaky inputs and sources that may be deeply suspect, gathered by researchers whose personal beliefs, institutional backgrounds, and blind spots heavily influence the questions they ask and the citations they choose to ignore. Scholars and critics sometimes call this systemic failure institutional bias, a phenomenon that can shape results unintentionally or, in some cases, through active oversight.

As a former dean at New York University, I have frequently sat on academic panels tasked with initiating data collection, designing extensive questionnaires meant to uncover emerging college trends. Typically, the other members drawn into these rooms come from the same elite, homogeneous pool: tenured scholars, senior faculty members, and high-level administrators. Many are old friends whom I meet from time to time at one academic event or another—grabbing coffee at a conference in Orlando, delivering a joint scholarly paper, sitting together on an academic board, or recommending a colleague for a prestigious award. So comfortable are we with each other, and so shared is our worldview, that our thoughts often channel along remarkably similar lines.

Only in retrospect have I come to realize that crucial decisions regarding which questions to ask and which to omit may utterly fail to cover the interests of those with whom we share no proximity. While academic committees often achieve a reasonable gender balance, other perspectives are routinely missing or poorly represented. The essential, lived voice of students is frequently left unheard. Also absent are faculty and staff hailing from lower-status academic disciplines. And, crucially, as happens so often across the United States and elsewhere, members of ethnic and racial minorities—including Black, Hispanic, South Asian, and other communities—alongside people with disabilities, are frequently uninvited from the table.

My colleagues, all serious and deeply committed academics, work with extraordinary determination to generate high-quality results, hoping to meet the urgent needs of faculty and students across the nation for solid answers. Their sense of academic responsibility is of the highest standard. But what essential data might fail to get reported simply because the right questions are never asked? What datasets might be generated if students played a central role in their design? What questions would Black faculty raise if they held the pen? Or Hispanic and other ethnic minorities? What lines of inquiry are suppressed simply because none of us possess the background or lived experience of those existing outside our insular circle?

During a decade spent serving as an online dean, I attended monthly institutionwide discussions exploring the best ways of forward momentum in digital education. A couple of dozen expert colleagues, drawn from diverse corners of the school—teaching and learning, technology, finance, and marketing, among others—sat around a giant, polished conference table in a handsome campus room overlooking a leafy park. Our discussions covered a sprawling list of topics that colleges and universities must address regarding online programs: support services, course design, digital tools, advising, tuition structures, and a cascade of other vital concerns. Yet, in all those years, students were never invited to participate, and I cannot recall ever seeing a Black colleague pull up a chair to join us at our table.

Just as with my experience in other academic settings, I now look back and wonder how thorough our deliberations truly were, recognizing that not a single student and not one Black colleague was present. What critical issues never got raised? What innovative programs never got considered? What training was never suggested? What crucial investments were never made? What questions never even came to mind because our academic and life experiences were entirely divorced from those of the people we excluded?

How much faith, ultimately, should anyone place in data generated at their own institution when the insights of ignored colleagues are entirely missing from the ranks of those who decide what we must know and what we may never learn?

On the wider higher education landscape, unintended bias can trigger serious and far-reaching consequences. For example, an article published recently in the journal of the American Educational Research Association reveals that widely used algorithms at many colleges to evaluate applicant potential can actively block African American and other minority students from being accepted because the digital tools employed are riddled with racist historical data.

“These models are significantly more likely to predict failure for Black and Hispanic students who actually succeeded and less likely to predict success for students who failed compared to White and Asian groups,” researchers discovered after evaluating the models.

When data collectors lack fundamental diversity, results routinely suffer from massive blind spots. High-status groups systematically design questions and build data collection mechanisms that reflect their own narrow institutional goals, rather than the varied needs of the wider student body or the broader faculty.

Serious policy moves by the current political administration—banning diversity training and courses and prohibiting identity-based hiring, among other aggressive actions—are central to the present broader assault on higher education. Yet, with the deepest of ironies, and even in the face of official deliberate ignorance, years of close scholarly study reveal that ethnic diversity is actually required to achieve the highest quality of scholarship. One major paper published in Nature Communications (9, 5163 [2018]), aimed at gauging the direct effects of diversity, analyzed more than nine million papers and six million scientists to uncover the intricate relationship between research impact and ethnic diversity, alongside other key elements such as discipline, gender, institutional affiliation, and academic age.

“Remarkably,” the study concludes, “of the classes considered, ethnic diversity had the strongest correlation with scientific impact.”

As artificial intelligence moves relentlessly forward across society, those who plug in the foundational sources that underlie the answers everyone is looking for must remain acutely aware that crucial information may be missing. With AI currently occupying an overwhelming share of our collective thought, basic questions about who actually collects the inputs remain relegated to the far-distant wings of our national drama. Doubts raised by critics who claim that materials feeding giant digital repositories can be falsely misleading are rarely at the center of our daily anxieties.

Instead, we worry endlessly about whether AI has feelings, when it might totally outsmart us, how it might invade our privacy, compromise the environment, spread sophisticated deepfakes, and, scariest of all, how it might inadvertently put an end to all humankind. In the meantime, however, we must remain vigilant about who is collecting data at our colleges and universities and who, to our collective shame, continues to be left out of the process.

Robert Ubell is vice dean emeritus of online learning at New York University’s Tandon School of Engineering and former editor of the New York Academy of Sciences monthly, The Sciences, and American publisher of Nature. A collection of his essays on virtual education, Staying Online: How to Navigate Digital Higher Education, is published by Routledge.

Leave a Reply

Your email address will not be published. Required fields are marked *