AI Detection in Higher Education
About AI Detection
AI detection tools are notoriously unreliable and inconsistent, and you can never
be certain that the results are
accurate enough to serve as evidence of Generative Artificial Intelligence (GAI)
use.
Many products claim 90% certainty of AI detection yet, but in practice demonstrate less than 60% accuracy because the engines designed to detect AI are constantly evolving. When considering the use of an AI detector, it is important to take the following into account:
- AI detection limitations and shortcomings
- Ethical use of often unreliable results
- Use of AI as a translation device for ESL students
- Impact on teaching and learning as a human-centered experience
GAI Strategies and Alternatives to AI Detection
Include a GAI Course Policy Statement in Your Syllabus
- Guide students on what, if anything, is permissible.
- Review your policy and expectations in the first class and periodically throughout the semester.
- Discuss the importance of ethical practices for students and out in the workplace.
Our guide to AI course policy statements provides information and examples of different types of policy statements.
Design Assignments and Activities with AI in Mind
- Be cautious of assignments that are easily completed by GAI (summaries, critical analysis, etc.).
- Favor discussions in class and activities that encourage immersive learning experiences (moderated discussions, study questions, group analysis, etc.).
- Be mindful of required source material (invite students to draw on and make connections between personal experience, specific sources, and course lecture materials).
- Encourage revision and reflection.
Encourage Hands-on and Creative Activities
- Ask students to take notes by hand and allow them to share their notes with you as part of a weekly learning journal.
- Allow students to submit handwritten homework is also worth considering. Students can easily scan their notes into a pdf format for submission. A 2024 article in Scientific American explains why handwriting is so beneficial for memory and learning. Consider sharing the article with them.
- Incorporate drawing, building, and other multimodal activities like podcasting and zines.
Experiment AI Detectors and GAI
- Try using a GAI models like PerplexityAI, Google Gemini, ChatGPT to get an understanding of the output generated.
- Become familiar with GAI output to recognize trends in formatting, how it replicates voice, and understand its strengths and limitations.
- Test AI Detection tools like GPTZero by submitting an examples of human-generated writing and then create some text using GAI and test it. If the result confirms GAI use, try using the GAI to rephrase or change the tone of the output and test again. Try GPTZero.
For more information on practical alternatives to AI detection tools, read the MIT Sloan School of Management's "AI Detectors Don’t Work. Here’s What to Do Instead."
Inside Higher Ed also provides an assessment of AI detection tools: "Professors Cautious of Tools to Detect AI-Generated Writing."
Resources
AI Course Policy Guide: A guide to design a course policy that suits your course preferences.
AI Course Policy Examples: A deeper dive into designing your AI course expectations policy.
AI Explorer: Learn what is happening in higher education and related industries including special projects, environmental impact, new products and related news, and explore AI technologies students and faculty are using.
Report from the FIT Faculty Senate Ad Hoc Committee on AI
SUNY FACT2 Guide to Optimizing AI in Higher Education
Possible AI Syllabus Statements (Brandeis Center for Teaching and Learning).
Citing Generative AI (APA and MLA styles covered).
Ethics of Creative AI: Detailed exploration of the ethics of using GAI in many different settings and circumstances.
Student Guide to Generative AI From Barnard College