System of language learning with augmented reality
Inventors
Smith, Sara Ashley • Carlo, Maria Soledad • Park, Sanghoon • Kaplan, Howard
Assignees
University of South Florida • University of South Florida St Petersburg
Publication Number
US-11810475-B2
Publication Date
2023-11-07
Expiration Date
2040-03-23
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
Education curricula materials include encoded indicia such as a QR code that contains information related to identifying requested augmented reality image data from a server over a network. By scanning the QR code, a computer uses its decoding software to create a data set for transmitting to the server. The data set may include an identifier for selected augmented reality image data associated with the user's curriculum, information about the curriculum at issue, the academic level of the user, and any other data necessary to ensure that the most appropriate augmented reality image data is transmitted back to the computer. The server transmits comprehensive augmented reality image data back to the computer for viewing on a computerized display accessible by a student. Part of the content may include an interactive pedagogical agent that helps the student with a part of the instruction related to a portion of the curriculum.
Core Innovation
The invention concerns a computerized system and method for teaching language, utilizing curriculum materials embedded with encoded indicia such as QR codes or printed symbols. When these symbols are scanned by a camera-equipped computer using imaging and decoding software, digital pixel data is generated and processed to form a data set containing information relevant to the educational content, such as curriculum type and user academic level. This data set is transmitted via a network to a remote server, which then identifies and transmits corresponding augmented reality image data back to the computer for display.
The displayed augmented reality image data includes interactive instructional content aligned with the user's curriculum. This content may be delivered through multimedia elements such as still images, video, audio, and especially interactive pedagogical agents (animated instructional characters) that assist the student with tasks related to a particular vocabulary lesson or curriculum segment. The system provides for real-time interaction using graphical user interfaces, allowing for a more personalized and immersive learning experience.
The problem addressed by this invention is the persistent academic gap experienced by English language learners (ELLs), especially those who speak a language other than English at home. These students often lack sufficient vocabulary knowledge to comprehend complex texts and keep pace with grade-level learning. Traditional educational technologies and instruction have not sufficiently addressed these deficits, especially regarding engagement, differentiation, robust exposure to new words, and the challenge of delivering instruction in the child’s first language when teachers lack proficiency. The disclosed system aims to ameliorate these difficulties by leveraging augmented reality to provide individualized, rich, and accessible vocabulary instruction.
Claims Coverage
There are two independent claims in the patent, each presenting distinct inventive features related to a computerized teaching system and a computer program product for decoding and displaying augmented reality educational content.
Computerized system of teaching using printed symbols and server-based augmented reality data
The inventive features include: - A computer with memory and processor running imaging and decoding software. - A camera with an image reader to generate digital pixel data from printed symbols (including QR codes) on curriculum materials. - Processing of digital pixel data to create a data set from the printed symbols. - A transceiver enabling bi-directional communication with a server on a network. - The server receiving data sets and returning selected augmented reality image data corresponding to the specific educational content. - The computer displaying the augmented reality image data.
Computer program product for decoding encoded indicia and displaying curriculum-aligned augmented reality
The inventive features include: - A set of computer instructions stored on non-transitory computer readable media. - An imaging module to activate a camera, capture images of encoded indicia, generate digital pixel data, and store this data in memory. - A decoding module to process the digital pixel data into a data set. - A transmission module to send the data set to a remote server that identifies and retrieves the corresponding augmented reality image data. - Additional instructions for receiving the augmented reality image data from the server via a network and displaying it on the computer.
The claims establish a system and corresponding computer program product for linking physical educational materials to server-stored, curriculum-aligned augmented reality content, through scanning, decoding, transmission, and interactive display mechanisms.
Stated Advantages
The system enables engaging, differentiated, and robust vocabulary instruction for English Language Learners by aligning augmented reality content with existing curriculum materials.
Augmented reality increases motivation, enjoyment, and learning outcomes by providing participatory and immersive experiences that support vocabulary acquisition.
The system supports instruction in both the learner’s first language and English, overcoming challenges when teachers do not know the student’s first language.
It creates individualized and flexible learning opportunities, including home modes that do not rely on parent English proficiency.
The system facilitates more exposures to vocabulary words with multimedia support, aiding students with limited English exposure.
Pedagogical agents in augmented reality add instructional support, demonstration, and encouragement, improving motivation and comprehension.
Teachers can direct students to appropriate targets, which helps manage large class sizes and limited instructional time.
The platform can align easily with existing hard copy or digital materials, such as flashcards and books.
Documented Applications
Supplements early childhood vocabulary instruction, particularly for English Language Learners using physical flashcards augmented with interactive AR content.
Integrates with curricula such as Developing Talkers for repeated shared book reading and interactive vocabulary learning in classroom or home settings.
Allows delivery of vocabulary instruction in both the student’s first language and English using multimedia AR, including interactive pedagogical agents.
Facilitates personalized learning by offering differentiated content for various academic levels, English proficiency, and instructional goals through scanning curriculum materials.
Interested in licensing this patent?