|
Bulletin of the Technical Committee on Learning Technology (ISSN: 2306-0212) |
Authors:
Fuzheng Zhao1
, Ayesha Khan2 and Islam Ahmed3
2: Meccah, Saudia Arabia
3: Cairo, Egypt
Abstract:
As artificial intelligence (AI) continues to revolutionize various sectors, its potential to transform education is increasingly recognized. However, the ethical implications of AI integration in educational settings, particularly in underprivileged contexts, demand careful examination. This paper explores the ethical considerations and future directions of AI implementation in education, drawing insights from the Philippines as a case study. Through an in-depth analysis of interviews with Professor Maria Mercedes T. Rodrigo, a professor and researcher specializing in educational technology and AI, this study delves into key ethical challenges such as informed consent, equity, and bias mitigation. The study highlights the need for strong ethical guidelines to ensure the fair use of AI in education. Informed consent is crucial to ensure that students and educators are aware of how AI tools are used and what data is collected. Equity concerns focus on providing equal access to AI resources for all students, regardless of their socio-economic background. Bias mitigation is essential to prevent AI from perpetuating existing inequalities. In addition, the paper recommends advancing ethical guidelines, empowering educators and students through AI literacy, and promoting international collaboration to share best practices. Addressing these issues helps educators, policymakers, and stakeholders navigate the ethical complexities of AI integration, harnessing its potential to enhance learning outcomes and promote inclusivity in education.
Keywords: Artificial Intelligence, Education Technology, Underdeveloped Countries, Ethical Considerations, Learning Outcomes
I. INTRODUCTION
AI has emerged as a transformative force in education, offering innovative solutions to enhance teaching and learning experiences (Chang, 2019). The application of AI technologies promises significant benefits, such as personalized learning, efficient administrative processes, and improved educational outcomes (Zhao et al., 2023). However, the ethical implications of AI implementation, particularly in underdeveloped countries, require careful consideration (Rodrigo, 2024). This paper aims to explore the ethical dimensions of AI integration in education, with a specific focus on the challenges and opportunities in underprivileged contexts such as the Philippines.
The insights presented in this paper are drawn from an interview with Professor Maria Mercedes T. Rodrigo (2024). Computer Science Education in the Philippines. ACM Inroads, 15(1), 48-53., A professor and researcher in educational technology and AI. Professor Rodrigo’s extensive research on the intersection of AI and education, particularly in the context of developing countries, provides valuable perspectives on the ethical challenges and potential solutions for AI implementation. The interview was conducted by a team of three researchers, each bringing diverse expertise to the discussion: Islam AHMED, Mechatronics Department in the Egyptian Academy for Engineering & Advanced Technology, Egypt; Coordinator in PDMA Egypt Chapter. Ayesha KHAN, Bachelor of Science in Computer Science, MacEwan University, Canada. Fuzheng ZHAO, PhD, Kobe University, Japan.
The structured interview focused on various aspects of AI integration in educational settings. Key topics included informed consent, equity and access to technology, cultural sensitivity, and the role of collaborative partnerships in overcoming resource constraints. Through an in-depth discussion, Professor Rodrigo highlighted critical ethical considerations and shared examples from her work in the Philippines. The primary outcomes of the interview include a detailed analysis of the ethical challenges associated with AI in education and practical recommendations for addressing these issues. By combining Professor Rodrigo’s insights with current research trends, this paper aims to contribute to the ongoing dialogue on responsible AI innovation in education and advocate for inclusive and ethically grounded approaches to technology integration in underprivileged contexts.
This study sets the stage for a comprehensive examination of the ethical considerations in AI implementation in education, drawing from expert insights and empirical evidence to provide a nuanced understanding of the topic.
II. Ethical Considerations in AI Implementation
The implementation of AI in education, especially in underprivileged contexts, raises numerous ethical considerations. These include ensuring informed consent, promoting equity and access to technology, and addressing cultural sensitivities and biases in AI models and studies. This chapter delves into these issues, highlighting insights from Professor Rodrigo’s interview and discussing their broader implications.
A. Informed Consent and Participant Understanding
Islam AHMED: “Professor Rodrigo, what are some of the challenges you’ve encountered regarding informed consent in your AI research projects in the Philippines?”
Professor Rodrigo: “Informed consent is indeed a critical issue, especially in contexts where literacy levels are low, and cultural norms differ. Many participants may not fully understand the implications of their involvement in AI projects. We’ve had to develop simplified consent forms and conduct verbal explanations in local languages to ensure participants truly understand what they are consenting to.”
Ayesha KHAN: “How do you ensure that this understanding is meaningful and not just a formality?”
Professor Rodrigo: “We incorporate interactive sessions where participants can ask questions and express concerns. Additionally, we involve community leaders to help explain the purpose and benefits of the research, which often helps in bridging the understanding gap.”
B. Equity and Access to Technology
Fuzheng ZHAO: “Can you elaborate on how the digital divide affects the implementation of AI in education in the Philippines?”
Professor Rodrigo: “The digital divide is a significant barrier. Many students do not have access to the necessary technology or the internet at home. This disparity means that AI tools, which require such access, are not equally available to all. Some government and non-government organizations have been working on community-based technology hubs to provide shared access points where students can use these tools.”
Islam AHMED: “Are there any government initiatives to support this?”
Professor Rodrigo: “Yes, there are national programs aimed at increasing access to technology and digital literacy. However, these are often limited in scope and need more extensive support and funding.”
C. Cultural Sensitivity, Biases in AI Models and AI Studies
Ayesha KHAN: “Bias in AI models and studies is a well-known issue. Can you explain the cause of bias in many AI studies and how you address cultural biases in your educational AI projects?”
Professor Rodrigo: “Bias in many AI studies is due to most data coming from Western, Educated, Industrialized, Rich, and/or Developed (W.E.I.R.D) countries who are equipped with the technology and resources to carry out studies in educational systems. This is why most data we have on how students interact with computer based educational systems (i.e. AI models) comes from countries, like America, Singapore, and many others, who have the ecosystem to carry out these complicated studies. Cultural biases can be deeply embedded in AI algorithms if the data used to train these models predominantly reflects certain cultural norms. We actively work on creating diverse datasets that represent the cultural context of the Philippines. Additionally, we involve local educators and students in the development process to ensure the AI tools are culturally relevant and sensitive.”
Fuzheng ZHAO: “Can you give an example of how this works in practice?”
Professor Rodrigo: “For instance, when developing language learning tools, developers can address local languages specifically and incorporate culturally relevant content. This helps in making the AI tools more effective and relatable to the students.”
D. Discussions
While the discussion on informed consent and participant understanding highlights the importance of ethical considerations in AI research, there are challenges in ensuring meaningful consent, particularly in underprivileged contexts like the Philippines (Rodrigo, 2024). Research by Cath (2018) emphasizes the need for informed consent processes that account for diverse cultural backgrounds and literacy levels to uphold ethical standards in AI research.
Additionally, addressing equity and access to technology is crucial for promoting inclusive AI integration in education. However, simply providing access to AI-enabled resources may not address underlying inequalities (Zhao et al., 2023). Studies by Strover (2019) underscore the importance of addressing structural barriers and promoting digital literacy to ensure equitable participation in technology-enhanced learning environments.
Cultural sensitivity and biases in AI models present ethical challenges that require careful consideration. Research by Mittelstadt (2019) highlights the pervasive biases in AI algorithms and the potential harm they can inflict, particularly on marginalized groups. Addressing these biases requires not only diverse representation in dataset creation but also ongoing monitoring and evaluation of AI systems to mitigate unintended consequences.
III. Challenges and Solutions in Underdeveloped Countries
Implementing AI in education within underdeveloped countries presents unique challenges, including resource constraints, infrastructure limitations, and the digital divide. This chapter explores these challenges and discusses potential solutions, drawing on Professor Rodrigo experiences and insights.
A. Resource Constraints and Infrastructure Limitations
Islam AHMED: “Resource constraints are a major hurdle. How do you navigate these limitations in your AI projects?”
Professor Rodrigo: “Resource constraints are indeed significant. Schools rely heavily on partnerships with non-profit organizations and international stakeholders to mobilize resources. These collaborations help them obtain the necessary technology and training materials to support AI initiatives.”
Ayesha KHAN: “What about infrastructure, like internet connectivity?”
Professor Rodrigo: “Infrastructure limitations are a challenge. In many areas, internet connectivity is unreliable. Some researchers in Brazil, for example, have been developing offline-accessible AI tools that can function without constant internet access, making them more suitable for these contexts.”
B. Strategies for Addressing the Digital Divide
Fuzheng ZHAO: “What strategies have proven effective in addressing the digital divide in your experience?”
Professor Rodrigo: “Mobile-based learning platforms are the most accessible. Many students have access to mobile phones even if they don’t have computers. Smart phones have the processing power to deliver multimedia content. Furthermore, public-private partnerships have been instrumental in expanding digital inclusion.”
Islam AHMED: “Can you give an example of a successful public-private partnership?”
Professor Rodrigo: “The Philippines Department of Education has partnerships with companies to provide low-cost or donated devices to schools. These partnerships help reduce the cost barrier and increase access to necessary technology.”
C. Collaborative Partnerships with Local Stakeholders
Ayesha KHAN: “How important are local stakeholders in the implementation of AI initiatives?”
Professor Rodrigo: “Engaging local stakeholders is vital. Government agencies, educational institutions, and community leaders provide essential support and insights that ensure AI initiatives are relevant and sustainable. Co-designing solutions with end-users helps in creating more effective and accepted interventions.”
D. Discussions
Professor Resource constraints and infrastructure limitations in underdeveloped countries pose significant challenges to AI implementation in education. While collaborative efforts are essential for mobilizing resources, there is a need for sustainable models that prioritize local capacity building and infrastructure development (Rieckmann, 2017). Without adequate investment in infrastructure and human capital, the potential benefits of AI in education may remain unrealized.
Strategies for addressing the digital divide must go beyond providing access to technology and focus on building digital literacy skills and promoting meaningful technology integration (Warschauer, 2004). Research by Selwyn (2010) emphasizes the importance of considering socio-cultural factors and the situated nature of technology use in designing effective interventions that bridge the digital divide and promote equitable access to educational opportunities.
Collaborative partnerships with local stakeholders are essential for the successful implementation of AI initiatives in underdeveloped countries. However, power dynamics and unequal partnerships can undermine the effectiveness of collaborative efforts (Lewallen et al., 2015). Engaging with local communities in participatory decision-making processes and prioritizing their needs and perspectives are critical for fostering genuine collaboration and ensuring the sustainability of AI interventions.
IV. Ethical Considerations in AI Implementation
This chapter presents a case study of AI implementation in the Philippine education system, highlighting the challenges, impacts, and lessons learned. The insights are based on Professor Rodrigo’s extensive work in this area, providing a comprehensive overview of AI-driven educational interventions in the Philippines (Rodrigo, 2024).
A. Overview of the Education System and Challenges
Ayesha KHAN: “Can you provide an overview of the challenges facing the Philippine education system?”
Professor Rodrigo: “The Philippine education system faces numerous challenges, including inadequate funding, overcrowded classrooms, and lack of teaching and learning materials. These issues contribute to low learning outcomes and widen disparities in educational attainment. Addressing these challenges requires innovative approaches and significant investment in educational reform.”
B. Impact of AI Initiatives on Learning Outcomes
Islam AHMED: “How have AI initiatives impacted learning outcomes in the Philippines?”
Professor Rodrigo: “We collaborated with the University of Illinois Urbana Champaign (UIUC) on the deployment of their What-If Hypothetical Implementations Using Minecraft (WHIMC). UIUC created a set of Minecraft worlds which show counterfactual versions of Earth (e.g. Earth with no moon) to be able to show students how different Earth would be. In order to bring these to Philippine classrooms, we worked with teachers to create lesson plans that integrated WHIMC. The student experience proved to be quite positive. Teachers observed that the students were more excited and engaged”
C. Lessons Learned and Best Practices
Islam Islam AHMED: “What lessons have you learned from implementing AI in education in the Philippines?”
Professor Rodrigo: “One of the key lessons is the importance of contextualized approaches to educational innovation. What works in one setting may not necessarily work in another, so it’s essential to tailor AI interventions to the specific needs and cultural context of the Philippines. Additionally, involving stakeholders at every stage of the process, from design to implementation, ensures that the solutions are relevant and sustainable.”
Ayesha KHAN: “Can you elaborate on the significance of localized approaches?”
Professor Rodrigo: “Certainly, when implementing the WHIMC project, it was crucial to tailor the integration to fit the Philippine curriculum. This meant introducing the project at the right point within the existing sequence of lessons, ensuring that it complemented the topics being taught and maximized student engagement and understanding”.
D. Discussions
The case study of AI implementation in the Philippines highlights the potential of AI-driven educational interventions to address systemic challenges in the education system. However, there is a need to critically examine the scalability and sustainability of these interventions beyond pilot projects (Vincent-Lancrin & Van der Vlies, 2020). Without adequate investment in teacher training, infrastructure development, and policy support, the impact of AI initiatives may be limited.
Lessons learned from AI implementation in the Philippine context underscore the importance of contextualized approaches to educational innovation. However, there is a need for rigorous evaluation and evidence-based research to determine the effectiveness and scalability of these approaches (Serdyukov, 2017). Longitudinal studies that track the impact of AI interventions on learning outcomes and educational equity can provide valuable insights into best practices and areas for improvement.
V. Future Directions and Recommendations
The imperative of advancing ethical guidelines for AI integration in education was explored, empowering educators and students through AI literacy, and promoting international collaboration and knowledge exchange in AI research and practice. Drawing upon insights from interviews with experts like Professor Rodrigo, we delve into key recommendations and considerations for the future of AI in education.
A. Advancing Ethical Guidelines for AI in Education
Fuzheng ZHAO: “What steps can be taken to advance ethical guidelines for AI integration in education?”
Professor Rodrigo: “Developing comprehensive ethical guidelines and standards is crucial for ensuring responsible AI use in education. Multi-stakeholder collaborations involving researchers, policymakers, educators, and technology developers are needed to establish ethical frameworks that prioritize learner well-being and empowerment. Transparency and accountability should be core principles guiding AI development and implementation.”
Islam AHMED: “Are there any existing initiatives or frameworks that could serve as a foundation for these guidelines?”
Professor Rodrigo: “Yes, several organizations, such as UNESCO and the IEEE, have developed guidelines for AI ethics in various domains, including education. These frameworks provide valuable insights and can serve as a basis for developing context-specific guidelines tailored to the needs of underprivileged contexts like the Philippines.”
B. Empowering Educators and Students through AI Literacy
Ayesha KHAN: “How can we empower educators and students to make ethical and responsible use of AI technologies?”
Professor Rodrigo: “Promoting AI literacy is essential. Educators and students need to develop critical thinking skills, digital citizenship, and ethical decision-making abilities in the use of AI tools. Educational initiatives focused on AI awareness, responsible use guidelines, and curriculum integration can empower learners to become informed and ethical users of AI technologies.”
C. Promoting International Collaboration and Knowledge Exchange
Islam AHMED: “How can international collaboration and knowledge exchange contribute to the advancement of AI research and practice in education?”
Professor Rodrigo: “Facilitating international collaboration is vital for sharing best practices, research findings, and lessons learned in AI implementation. Platforms for knowledge exchange, such as conferences, workshops, and online forums, provide opportunities for researchers, practitioners, and policymakers to learn from each other’s experiences and collaborate on joint initiatives.”
Ayesha KHAN: “Are there any specific challenges or barriers to international collaboration in AI research?”
Professor Rodrigo: “Yes, challenges such as language barriers, cultural differences, and unequal access to resources can hinder effective collaboration. Overcoming these barriers requires fostering a culture of openness, inclusivity, and mutual respect, as well as providing support for capacity building and resource sharing.”
D. Discussions
Advancing ethical guidelines for AI in education requires a multidisciplinary approach that considers the social, cultural, and ethical implications of AI technologies (Rodrigo et al., 2023). Research by Floridi et al. (2020) emphasizes the importance of incorporating ethical principles into AI design and development processes to ensure that AI systems align with human values and respect fundamental rights.
Empowering educators and students through AI literacy is essential for promoting responsible and ethical AI use. However, there is a need for comprehensive teacher training programs that provide educators with the knowledge and skills to integrate AI technologies effectively into teaching practice (UNESCO, 2021). Without adequate support and professional development opportunities, educators may struggle to leverage the full potential of AI tools in educational settings.
Promoting international collaboration and knowledge exchange is vital for advancing AI research and practice in education. However, efforts to promote global collaboration must be accompanied by measures to address power imbalances and ensure equitable participation (Kizilcec et al., 2020). Initiatives that prioritize knowledge sharing, capacity building, and mutual learning can facilitate meaningful collaboration and contribute to the development of inclusive and ethical AI ecosystems in education.
VI. Conclusions
This paper has explored the ethical considerations surrounding the implementation of AI in education, with a focus on underprivileged contexts like the Philippines. Through insights from an interview with Professor Rodrigo and an analysis of current research, key ethical challenges and potential solutions have been examined.
The discussion highlighted the importance of informed consent, equity and access to technology, and cultural sensitivity in AI implementation. Challenges such as low literacy levels, digital divide, and cultural biases present significant ethical hurdles that must be addressed to ensure equitable and responsible use of AI in education. In addressing these challenges, collaborative partnerships with local stakeholders and contextualized approaches to AI development are crucial. Initiatives aimed at promoting AI literacy among educators and students, as well as facilitating international collaboration and knowledge exchange, can further advance ethical AI integration in education.
By synthesizing expert insights and empirical evidence, this paper contributes to the ongoing dialogue on responsible AI innovation in education. It provides actionable recommendations for researchers, policymakers, and educators to navigate the ethical complexities of AI implementation and promote inclusive and ethically grounded approaches to technology integration in underprivileged contexts. Through continued research, collaboration, and ethical reflection, we can harness the transformative potential of AI to create more equitable and empowering learning experiences for all learners, regardless of their socioeconomic background or geographic location.
Reference
[1] C. Cath, “Governing artificial intelligence: ethical, legal and technical opportunities and challenges,” Phil. Trans. R. Soc. A, vol. 376, no. 20180080, 2018. [Online]. Available: http://doi.org/10.1098/rsta.2018.0080
[2] S. Strover, “Public libraries and 21st century digital equity goals,” Communication Research and Practice, vol. 5, no. 2, pp. 188-205, Jun. 2019. https://doi.org/10.1080/22041451.2019.1601487
[3] B. Mittelstadt, “Principles alone cannot guarantee ethical AI,” Nature Machine Intelligence, vol. 1, no. 11, pp. 501-507, Nov. 2019.
[4] M. Rieckmann, Education for Sustainable Development Goals: Learning Objectives, Paris, PAR, France: UNESCO, 2017, pp:6-11.
[5] M. Warschauer, Technology and Social Inclusion: Rethinking the Digital Divide. Cambridge, MA, USA: MIT Press, 2004. Pp:31-48.
[6] N. Selwyn, Schools and Schooling in the Digital Age: A Critical Analysis. London, UK: Routledge, 2010. Pp:3-22.
[7] T. C. Lewallen et al., “The whole school, whole community, whole child model: A new approach for improving educational attainment and healthy development for students,” Journal of School Health, vol. 85, no. 11, pp. 729-739, Nov. 2015.
[8] S. Vincent-Lancrin and R. van der Vlies, “Trustworthy artificial intelligence (AI) in education: Promises and challenges,” OECD Education Working Papers, no. 218, OECD Publishing, Paris, France, 2020. [Online]. Available: https://doi.org/10.1787/a6c90fa9-en
[9] P. Serdyukov, “Innovation in education: what works, what doesn’t, and what to do about it?” Journal of Research in Innovative Teaching & Learning, vol. 10, no. 1, pp. 4-33, 2017. DOI 10.1108/JRIT-10-2016-0007
[10] M. M. T. Rodrigo, “Computer Science Education in the Philippines,” ACM Inroads, vol. 15, no. 1, pp. 48-53, 2024. https://doi.org/10.1145/3644818
[11] M. M. T. Rodrigo et al., “The great challenges and opportunities of the next 20 years,” Handbook of Artificial Intelligence in Education, pp. 606-649, 2023. https://doi.org/10.4337/9781800375413.00040
[12] M. M. T. Rodrigo, “What AI Tells Us About How We Learn,” Acts of Magis, no. 8, 2020. [Online]. Available: https://archium.ateneo.edu/acts-of-magis/8
[13] M. M. T. Rodrigo, “Is the AIED Conundrum a First-World Problem?” International Journal of Artificial Intelligence in Education, vol. 34, no. 1, pp. 55-61, 2024.
[14] F. Zhao, G. Z. Liu, J. Zhou, and C. Yin, “A learning analytics framework based on human-centered artificial intelligence for identifying the optimal learning strategy to intervene in learning behavior,” Educational Technology & Society, vol. 26, no. 1, pp. 132-146, 2023.
[15] M. Chang, Foundations and Trends in Smart Learning, E. Popescu, N. S. Chen, M. Jemni, R. Huang, J. M. Spector, and D. G. Sampson, Eds. Singapore: Springer, 2019.
All authors contributed equally to this work.
The interview recording can be found on the IEEE TCLT YouTube Channel (https://www.youtube.com/watch?v=r3GqPQanHlI).
Authors
Fuzheng ZHAO
was born in December 1988 in Weifang, Shandong, China. He earned his Ph.D. in Engineering from Kobe University, Kobe, Japan. His fields of study include educational big data mining and analysis, learning behavior analysis, and the design and development of artificial intelligence systems. From 2014 to 2019, he worked as an engineer at the Educational Technology Center of Jilin University in China. His responsibilities included designing, developing, and maintaining online learning platforms, systems, and tools. He is currently serving as an engineer at Jilin University. Dr. Zhao is a member of IEEE. He has received several accolades, including the Chinese National Graduate Scholarship in 2012, and the Japanese Ministry of Education Doctoral Scholarship in 2019.
Ayesha Khan
was born on February 27, 1992, in Meccah, Saudia Arabia. She moved to Canada in 2000 and has completed two Bachelor of Science degrees from MacEwan University in Edmonton, Alberta. Her first degree focused on Biology and her second degree focused on Computer Science. Her end goal is to complete a PhD in Data Science and Artificial Intelligence. IEEE Member since 2024. Winner of the best paper award in the category of Big Data, Data Management, and Analytics at the IEEE CCWC 2024 Conference.
Islam Ahmed
was born in Cairo, Egypt, and graduated from the Higher Technological Institute in 2019 with a degree in Mechatronics Engineering, where he ranked third in my class. Currently, he is pursuing a Master’s degree at Benha University. Following graduation, I embarked on a career as a Teaching Assistant, accumulating three years of experience assisting in courses within the field of Mechatronics Engineering. Presently, he is employed as an Embedded Software Engineer at Valeo Egypt, a leading automotive supplier. In this role, he collaborates on diverse projects with major automotive companies such as Diamler Mercedes, specializing in the design and development of embedded software solutions aimed at enhancing vehicle performance and functionality. Professionally, he actively contributes as a member of the IEEE Egypt section, demonstrating my dedication to advancing technology and engineering practices. Moreover, he holds affiliations with two specialized societies: Robotics and Photonics, underscoring his profound interest and active participation in cutting-edge technological advancements.