ADVERTISEMENT

ADVERTISEMENT

New artificial intelligence helps teach Brainerd ASL students

While wearing special gloves, students sign into a camera, which picks up their hand movements and determines if the word they attempted to sign is correct.

020220.ASLTechnology.jpg
Central lakes College student Lindsey Juers uses the SignAll technology to fine tune her American Sign Language skills Thursday, Jan. 30, in the college library. Central Lakes College is the fourth college in the country to employ this new technology. Steve Kohls / Brainerd Dispatch

Students studying American Sign Language at Brainerd High School and Central Lakes College are learning the language in a whole new way, thanks to a pilot program at both the schools.

SignAll, a Hungary-based business, developed an artificial intelligence system designed to help educate students and improve business relations. Because ASL teachers at CLC and the high school are members of the ASL Honor Society, the schools get to be part of a pilot program to test out the new technology.
BHS is the first high school in the nation to receive the equipment, while CLC is the fourth college in the U.S.

It’s new artificial intelligence, which allows ASL students to use this as a tool to make sure they’re signing things correctly, to make sure their finger spelling is accurate and their hand shapes perhaps are accurate as well,” said CLC ASL instructor Tanya Hoting Mrazek Thursday, Jan. 30, as students in one of her classes demonstrated the system.

While wearing special gloves, students sign into a camera, which picks up their hand movements and determines if the word they attempted to sign is correct.

“The artificial intelligence actually calibrates their specific body and their movements to their account, so then every time they sign in, their account pops up with their specific calibration, and then the system is able to read the gloves,” Hoting Mrazek said.

ADVERTISEMENT

Different exercises on the machine give students a variety of words to sign. If they are correct, a star will pop up. If they’re incorrect, a video will play showing the correct sign, and the students will have to do it again until they get it right.

020220N.BD.ASLTechnology2.jpg
Hailey Frankenberg practices her color signs Thursday, Jan. 30, at Central Lakes College. American Sign Language students were given the opportunity to train on the SignAll machine. Steve Kohls / Brainerd Dispatch

“I like that it gives you instant feedback,” CLC student Lindsey Juers said. “So you don’t have to have another person that knows ASL to practice.”

Teachers receive feedback as well, letting them know how their students are doing. Both Hoting Mrazek and BHS ASL teacher Jody Converse said this feature is useful for them.

“So if a majority of the class is struggling with a specific sign, then I can improve my teaching by going back and reteaching those sections,” Converse said during an ASL 2 class Friday, Jan. 31. “So it’s been wonderful technology to have.”

It helps a lot for Converse’s larger classes, too.

“With the classes as large as I have in here, sometimes it’s hard to catch every little thing that the students are doing. So they can go in the SignAll lab and independently study and improve their signing skills,” she said.

ADVERTISEMENT

And with limited classroom time, students are able to use the equipment on their own time outside of class to get even more practice in if they want.

For Emily Smith-Lundberg, the technology is groundbreaking. Smith-Lundberg is an ASL mentor at CLC who helps out in Hoting Mrazek’s classes. As a deaf person herself, she’s able to give hearing kids experiences with native signers.

“Artificial intelligence is not something that will replace a teacher in a classroom, of course, or replace interaction with deaf and hard of hearing people, but it’s a wonderful tool to use to improve their sign skills,” she said, noting the system uses native ASL signers as their sign models.

020220.N.BD.ASLTechnology7.jpg
Jody Converse, American Sign Language teacher at Brainerd High School, talks about the advantages of the SignAll technology in her classroom on the south campus. Steve Kohls / Brainerd Dispatch

“SignAll was created in collaboration with hearing and deaf people, so they are producing language models from native ASL users,” Smith-Lundberg added. “So many times when these things are developed, they are not developed with deaf people in mind, and this was developed in collaboration, in conjunction with the deaf community.”

BHS student Aden Crabb appreciates that collaboration as well.

ADVERTISEMENT

“I think it’s very innovative, as far as the difference between two cultures, the hearing and non-hearing,” Crabb said. “This would easily break the threshold between them because this, it teaches you signs, but you don’t need anyone else. You can just do this.”

020220.N.BD.ASLTechnology6.jpg
Brainerd High School American Sign Language student Aden Crabb uses SignAll technology during class Friday, Jan. 31, on the south campus of the school. Steve Kohls / Brainerd Dispatch

As part of the pilot program, Hoting Mrazek and Converse get to make suggestions and send their feedback to SignAll.

“This company has been amazing to work with,” Hoting Mrazek said. “SignAll is very innovative, and it’s very receptive to the needs of the folks that are using their equipment. So they’ve been really great about making changes and improving their system, and they do updates all the time.”

Both teachers are excited to be testing out the SignAll technology and said it has significantly impacted their classrooms.

THERESA BOURKE may be reached at theresa.bourke@brainerddispatch.com or 218-855-5860. Follow her on Twitter at www.twitter.com/DispatchTheresa .

Theresa Bourke started working at the Dispatch in July 2018, covering Brainerd city government and area education, including Brainerd Public Schools and Central Lakes College.
What To Read Next
Get Local

ADVERTISEMENT

Must Reads
Exclusive