Workshop 1 (19 August 2024)
Enhancing and Digitizing Professional and Scholarly Publications for Greater Social Impact at the AI-area: Theoretical Basis, AI-tools and Hands-on Practices
Intended learning outcomes
The overall aim of this workshop is for participants to learn about recent development in Generative AI, its implications for scholarly publication, as well as digital humanities and its extension to digitizing professional and scholarly outputs for wider access and greater social impact. Workshop participants will also be introduced of the relevant tools to produce a 1-minute video based on their own professional or scholarly outputs.
The intended learning outcomes of this workshop are for participants to:
- gain a better understanding of theoretical concepts related to digital humanities and multi-model presentation of professional and scholarly output in the form of online database and short-videos;
- have an increased awareness of the available resources and AI-based tools that can be used to assist individual researchers to produce, digitize and store their scholarly outputs for wider dissemination and greater social impact;
- To learn to use some of the tools and have hands-on practices with them to build their own 1-minute videos and storing in public platforms for dissimilation.
Workshop Content
The workshop will last for 4 hours and be divided into four interrelated sessions:
Session 1 – Conceptual basis (30 minutes): this session will focus on the theoretical and conceptual basis of digitalization of professional and scholarly outputs, drawing the participants’ attention to the waves of digitization in higher education and the increasing needs for professional and scholarly research to have social impact. The session will have 20 minutes of presentation followed by interactions with the participants.
Session 2 – Demonstration 1 (45 minutes): this session will introduce several recent AI-based tools and demonstrate how they can be used to facilitate efficient processing of scholarly source materials to enhance research publication.
Session 3 — Demonstration 2 (45 minutes): this session will demonstrate several cases where the researchers have digitized their professional resources and research outputs in the forms of searchable online databases and short-videos for wider dissimilation (knowledge transfer) and greater social impact.
Session 4 – Hands-on practice (120 minutes): in this session we will ask workshop participants to work on an initial plan to transform one of their professional or research output into a short-video. In particular, participants will be guided to work on the video-production tools to produce a one-minute video showcasing their research background and key findings. This will allow participants to traverse from the conceptual to the practical side and form a plan to produce short-videos based on their own scholarly outputs.
Teaching Methods
Our workshop will be interactive with many opportunities for paired/group work and discussions. We will be working with case demonstrations and examples from existing materials in order to ground the workshop in real-world issues and applications.
Participants will also be asked to bring their own materials so that the course content could be better tailored to their professional needs. The teaching content will be drawn from the latest and most relevant empirical research on the topics covered.
Pre-workshop activities
Participants will be given a couple of suggested readings. They will also be asked to bring a recent professional or scholarly publication that they would like to digitalize for wider dissimilation.
Workshop facilitators
Dr. Qin Xie holds a PhD in language assessment and evaluation from the University of Hong Kong. She is currently working at the University of Macau as Associate Professor of LanguageAssessment and Evaluation. Her research covers the topics of washback, test preparation, test validation and diagnostic assessment, from which she has published over 35 research articles in high-impact international journals such as Language Testing, Language Assessment Quarterly, Assessing Writing, Language Teaching, Systems, and Educational Psychology. She won multiple competitive research grants (over 2 million HK$) including the prestigious grants from Early Career Scheme (ECS) and General Research Fund (GRF) in Hong Kong, the Duolingo English Test Research Grant, Duolingo, US., among others.
Qin served the Asia Association of Language Assessment (AALA) in the role of Member-at-Large Elect for two terms (2019-2023), working with the Executive Board to oversee AALA’s annual conferences and supervising student committees with the Vice president. Qin has also been serving the community as Associate Editor of Language Assessment Quarterly and Journal of Asia TEFL, as EB member of three indexed journals (Language Teaching Research Quarterly, rEFLections, and Language Education & Assessment), and a regular manuscript reviewer for a dozen of applied linguistics journals.
Dr. Galaxy Cao Jiaxin holds a PhD in Educational Technology from the Education University of Hong Kong. Dr. Cao has extensive experience developing education-related digital products, such as meta-verse, dashboard, academic website, and online database. He has collaborated with Dr. Qin Xie to produce a searchable online database to store language testing materials produced by pre- and in-service teachers in Hong Kong to assess school students’ English language skills. Dr. Cao will introduce the online database, its technical infrastructure, usages and maintenance. He will also introduce useful AI-tools to help participants to take advantages of these tools in conducting literature review and publishing scholarly research.
Miss. Annie Chang Zhang is currently a Year 4 doctoral student at the Education University of Hong Kong. Her doctoral thesis project focused on multi-model composing and academic presentations. Currently, Annie is at the final stage of her doctoral research and has three manuscripts under review for consideration of journal publications. Annie has also presented on multiple international conferences to dissimilate her research findings. She has extensive experience working with academic video production and editing. She will help workshop participants to learn how to work with the video production tools to produce scholarly videos based on their own scholarly publications.
Miss Yang Yang is currently a Research Assistant at the Education University of Hong Kong. She holds both a MA degree in applied linguistics from the Chinese University of Hong Kong and a BA degree in Chinese language. Miss Yang has successfully produced multiple scholarly videos based on Dr. Xie’s journal publications. Based on her extensive work experience, Yang Yang will share the caveats and pitfalls for each new production, as well as critical stages of digitizing scholarly outputs, useful procedures, strategies and tips at various steps.
Workshop 2 (19 August 2024)
Applying General Linear Model and Linear Mixed-Effects Model in Language Assessment Research
Intended Learning Outcomes:
The general linear model (GLM) and linear mixed-effects model (LMEM) are useful tools in language assessment and learning research. This workshop is designed to introduce participants to the foundational concepts and practical applications of GLM and LMEM in language assessment and learning research. Participants will learn to apply these models using Jamovi (or JASP), two user-friendly and open-source statistical software packages. The workshop will cover the basics of GLM, including factorial ANOVA and linear regression, and extend to LMEM, which is particularly useful for handling nested data structures and longitudinal data common in language research. Participants will engage in interactive exercises, which aim to enable them to apply learned concepts, analyze and interpret findings, and make informed decisions regarding their research designs.
Workshop Content:
The workshop will last for approximately 5 hours and be divided into the following themes:
Theme 1 – Introduction to GLM: Basics of factorial ANOVA and linear regression.
Theme 2 – Introduction to LMEM: Understanding nested data structures and longitudinal data in language research.
Theme 3 – Hands-on Application with Jamovi: Interactive exercises to apply GLM and LMEM using Jamovi.
Theme 4 – Hands-on Application with JASP: Interactive exercises to apply GLM and LMEM using JASP.
Theme 5 – Data Analysis and Interpretation: Analyzing and interpreting findings from GLM and LMEM analyses.
Theme 6 – Research Design Considerations: Making informed decisions regarding research designs based on GLM and LMEM results.
Note:
These themes will not be presented sequentially.
Teaching Methods:
– Interactive lectures to introduce concepts and methodologies.
– Hands-on exercises using Jamovi and/or JASP to apply learned concepts.
– Group discussions to facilitate understanding and interpretation of results.
Pre-Workshop Activities:
– Participants are required to install Jamovi and JASP on their laptops.
– Participants should ensure internet connectivity for the optimal use of Jamovi.
Jamovi: https://www.jamovi.org/download.html
JASP: https://jasp-stats.org/download/
Workshop Facilitators:
Dr. Vahid Aryadoust is an Associate Professor of language assessment at the National Institute of Education of Nanyang Technological University, Singapore; an Honorary Associate Professor, the Institute of Education, UCL, London; and a Visiting Professor, Xi’an Jiaotong University, China. His areas of interest include generative AI in language assessment, meta-analysis, and sensor technologies such as eye tracking, brain imaging, and GSR in language assessment. Dr Aryadoust has published his research in Computer Assisted Language Learning, Language Testing, System, Current Psychology, Language Assessment Quarterly, Assessing Writing, Educational Assessment, Educational Psychology, etc. He has also (co)authored a number of book chapters and books that are published by Routledge, Cambridge University Press, Springer, Cambridge Scholar Publishing, Wiley Blackwell, etc. Vahid has also led a number of assessment research projects supported by educational fund-providers in Singapore, USA, UK, and Canada. He is a member of the Advisory Board of multiple international journals and has been awarded the Intercontinental Academia Fellowship (2018–2019).