Using AI-Generated Feedback to Improve Critical Thinking and Writing Proficiency

Abstract

Research indicates students require customized written composition feedback to enhance critical thinking and writing competence, yet teachers face barriers to delivering timely personalized guidance due to heavy workloads. To address this gap, this study developed the Writing Improvement and Smart Evaluation Agent (WISE Agent), an artificial intelligence (AI) feedback tool targeting textual logic and perspective biases in student essays. We conducted a three-month intervention with 260 Chinese sixth-grade students, each completing seven themed essays and receiving targeted WISE Agent feedback shortly after submission. Assessment used a critical thinking rubric adapted from the California Critical Thinking Disposition Inventory (CCTDI), covering seven core dimensions including cognitive maturity and open-mindedness. Results indicate structural optimizations in critical thinking dimensions rather than a uniform increase in total scores. While the overall enhancement was non-significant, granular analysis revealed divergent developmental trajectories: lower-performing students advanced in evidence selection, while higher-performing students excelled in perspective diversification. This study suggests that WISE Agent serves as an effective cognitive scaffold, facilitating incremental critical thinking development through personalized feedback loops, providing a practical pathway for AI-supported critical thinking cultivation.