The Sound of Math

A colorful depiction of a piano amidst graphing coordinates and a list of math functions.
Finalist in Desmos Global Math Art contest.

The idea of representing math through sonic information might be a rather new and abstract concept for many.

For a lot of people, the meaning behind a sonic waveform is just the noise it makes. For instance, do you know what sin(x)+2 sounds like?

Can you provide an example?

By the end of this article, you will be able to answer yes to both of those questions.

Concepts of Sonic Data

For audio information, there are a number of issues that have historically been more constraining than liberating in terms of our ability to create and use it. Namely, a lack of tools and the related supporting culture of practice and use.

Most people have simply never encountered math deliberately represented through audio- or if they did, they probably didn’t realize it was happening.

Students and teachers need to have some preparation for using audio versions of math. Some overview of what is being represented, with context provided as to what the different sonic palettes represent, and how to interact with significant data.

The Evolution of Sound

Beyond live sound, our technological capability to record and produce sound continues to grow. We started in the world of analog audio, and ironically, many hipsters continue to return there…

An analog recording of sound is a direct and singular representation of something in the world. It is evidence of a unique moment in time, a direct translation of some event or data. It typically can not be reproduced without losing fidelity, making each use one time closer to the last time it will ever be usable.

Traditionally, there have been constraints related to the cost and complexity of analog audio recording technology that put audio-based math out of reach for most people.

Issues from recording equipment, barometric pressure, ambient temperature and humidity, the list goes on. Suffice it to say that there are many variables which combine into a very challenging situation when trying to re-create consistent representations of sound.

It helps to have a recording studio.

man sitting in a recording studio
Photo by John Hult on Unsplash

And don’t forget the talent, we need a source of the sound – a means of making noise. Cue the orchestra, or get out the xylophone, slide whistle, and kazoo.

For the longest time, in order to capture sonic information, the task required a range of expensive and sophisticated recording equipment (and audio engineers to operate it). This resulted in it being out of the reach of most teachers and students.

Happier Times

Today technology for making and distributing noise is ever-present. We carry the equivalent of a recording studio in our cell phones, as well as the means of distributing our noise across the globe. I give you the Internet as exhibit A.

The Internet has provided the means for a new paradigm where audio information is easy and affordable to record and share. We can even synthesize conceptual never-before heard sonic information according to our desires, with a variety of free tools.

Today audio technology enables us to create new kinds of sounds our grandparents would most likely not approve of.

And you can count on that…

Combining Sound and Sight for Superior Communication

A central tenant of media theory is that multiple means of representing information reinforces the message being communicated.

Today we have a unique capability to express information in a variety of ways. We combine multiple forms of media into much more engaging representations than formulas scribbled in chalk or dry erase markers.

For example, consider the complexities of data-sorting algorithms, and the need to compare the logic of the algorithm in a way that demonstrates efficiencies and differences in theoretical approaches.

Written in text. a lengthy tome of incredibly boring dimensions is the result. It could easily take an hour to read this explanation, while it is represented in a fraction of the time through this YouTube video “Fifteen Sorting Algorithms in 6 Minutes”.

Besides being slightly hypnotic, this video efficiently demonstrate a rather abstract concept and relationship between the techniques of different coding approaches (sorting algorithms) used in computer science.

As a lot of people figured out in the 60’s, it is easy to get absorbed into the engaging mixture of audio-reinforced visuals. Now we can tap into that power for teaching and learning Math.

History of Sonic Math

Audio Graphing is the term applied to the process for sonic rendering of mathematic information.

As an instructional technology, audio graphing provides an interesting capability for teaching and learning – though it is not as familiar to most of us as the visual representation of math.

Audio Graphing has remained a niche use for people with disabilities, or else individuals who were deep into the science of math or sound.

The main issue has been the lack of tools that made it easy for average people to create or use audio graphing.

The most popular and reliable tool for many years was an expensive technology relegated to the fringes of assistive technology for students who were blind and studying math. Costing several hundred dollars, it was an unfortunate stranglehold on a powerful capability.

There is one notable tool from the past that still deserves some attention both for capability and for the spirit of supporting education for everyone: MathTrax from the fine folks at NASA.

MathTrax is a great example of how audio graphing can help explain math functions and concepts. It is an accessible graphing calculator that allows for individuals with disabilities to create and listen to math. There are also built-in samples for exploring the physics and functions of rocket launches and roller coasters, and it is all accessible.

As cool as all that is, it is still a rather limited range of options and a very outdated interface.

Happily, the world has changed for the better in terms of our ability to create and study math with audio graphing capabilities.

Current Evolution of Sonic Math: Desmos

Home page for desmos.com.
Home page for desmos.com.

Desmos is a company that provides a free suite of web-based math tools, which includes an impressive audio graphing calculator that is completely accessible, and it works across operating systems and devices.

Did I mention it’s free?

Desmos works to ensure their tools are accessible and available across operating systems and devices, as part of their mission to make math easier and more enjoyable to learn for everyone.

In addition to an impressive collection of math tools, Desmos provides free lessons and activities you can use to teach math with their tools.

Using Desmos to create content for the LMS

To use Desmos, go to www.desmos.com and create an account.

You need an account to save and share the content you make, but anyone can visit the URL for what you create – with no account required to view your content.

Before you begin, I recommend you read the page about how to best succeed in creating great digital math. It is really quite good advice.

Math Tools

Under the “Math Tools” menu you will find the different tools included in the free suite. There’s a lot of good stuff here, but today I’m focusing on the Graphing Calculator.

Desmos' math tools, with Graphing Calculator highlighted.
Desmos’ math tools, with Graphing Calculator highlighted.

Graphing Calculator

Click on the Graphing Calculator option from the Math Tools menu, and the Graphing Calculator opens in full-window mode.

An empty graph awaiting your math.
An empty graph awaiting your math.

No ads to distract, no interruptions to sign up for the newsletter, just good old-fashioned, blast it out loud audio math.

That’s right – this ain’t your grandpa’s math. But actually, go ahead and turn up your speakers and let Grandpa learn something too.

Here is how you get it done:

First, click the big PLUS sign in the upper left-hand corner.

Adding content to your graph.
Adding content to your graph.

Choose “f(x) expression”.

Next, enter your expression via the keyboard or through the onscreen entry tool-pane.

Graphing Calculator tools.
Graphing Calculator tools.

Notice the collection of common functions that can save you time in data entry. Here is the complete list of supported functions.

Functions panel.
Functions panel.

When you have finished creating/editing your expression, press ENTER.

If your expression is a valid function, it will be added to the graph.

AUDIO Graphing

Here is how to play your math out loud:

  1. With your expressions selected, press ALT + T to engage the audio graphing tool.
  2. Press H to hear the entire expression.
  3. Use TAB to navigate through significant points like intersections with other functions or axis markers.
  4. Use the ARROW KEYS to navigate along the graph in either direction.

Share Your Math with the World

To show your work outside of Desmos, click on the “Share Graph” icon in the upper right-hand corner.

The Share Graph icon.
The Share Graph icon.

You can download a picture, send someone a link, or embed the code within an HTML page.

Exporting a graph as an image.
Exporting a graph as an image.

Following is the same information via an HTML embed code:

Using Desmos as a Student

Before unleashing your audio graphs on your students, you should introduce your students to the concepts of using audio graphs and the different keyboard commands for interacting with the audio graphing calculator.

Desmos provides a thorough overview of how they support accessibility, including technical information and instructions for using their product with different screen readers and assistive technologies, across different operating systems and devices.

In addition to being keyboard accessible, Desmos also provides a “Projector Mode” that makes the lines fatter and easier to see when displayed through a projector. Projector Mode also helps when a graph is being viewed on a mobile device outside, or when being viewed by someone with a visual impairment.

Desmos Unlocks the Potential of Math for Everyone

Desmos products are used by millions of students around the world, and they are unlocking the ability to find solutions to universal questions and problems while helping every student realize their individual potential, understanding, and mastery of math.

As if they weren’t already the coolest math company in the world, or maybe because they are, Desmos is sponsoring a Global Math Art contest. Please check it out, and enjoy the amazing visual and audio prize winning content – all created with pure math.

Here is the first place winner for the 13-14 Year-old Age Category:

And here is the best Audio Graph winner:

Visit the Global Math Art Contest page and see all the winners across different age categories, and share with anyone who ever tells you math is boring.

Now you know differently.

Thanks for reading!

Resources for Independent Remote Learning

Woman works on a laptop with an Android sticker.
Photo by Christina @ wocintechchat.com on Unsplash

In a perfect world, both our students with disabilities and our faculty would be properly supported with the resources they need to excel and thrive.

While our world might still be a work in progress, we are fortunate to be able to support each other as much as possible during these “interesting” times.

For those of you who may be teaching students with disabilities at a distance, I know there is never enough support, and now even less with students away from campus-based support services. I’m writing this post to cover some resources for accessibility that everyone should know about, but many don’t.

Computer OS Assistive Technology Capabilities

There are many different types of disabilities, and we have many corresponding forms of computerized assistive technology to help address the needs of individuals with these different disabilities. As modern computer operating systems have continued to evolve, they also have become more accessible through built-in assistive technology.

Most modern computer operating systems incorporate some level of assistive technology. Both Windows and Mac OS feature a set of assistive technology tools for magnification, screen reading, and speech recognition.

While the built-in assistive technology is rarely equal to dedicated assistive technology applications, it can be useful and sometimes provide adequate access in a pinch.

Here is a very brief look at some of the available assistive technology that your students might benefit from knowing about.

Windows Built-in AT

Windows 10 Settings with Ease of Access option highlighted.
Windows 10 Settings and Ease of Access.

Windows 10 provides a variety of options for customizing your computing experience. Visit the “Ease of Access” center from the System Settings to get started.

Assistance for Low Vision and Blindness

Windows features a variety of color and cursor configurations as well as other system schemes to make things easier to see.

Windows 10 Display options from Ease of Access settings.
Windows 10 Display options from Ease of Access settings.

There are two applications in the Windows 10 Ease of Use section dedicated to assisting individuals with low vision or blindness, Narrator and Magnifier.

Windows 10 Accessibility Keyboard Commands can be helpful when trying to use these different forms of AT as well as other aspects of your computer experience.

Narrator

Microsoft Narrator is a screen reading application that allows you to navigate around the Windows environment and read properly formatted documents.

The default keyboard command to start Narrator is WINDOWS KEY + CTRL + ENTER.

To configure the settings for Narrator, press WINDOWS KEY + CTRL + N.

Magnifier

Windows 10 Magnifier settings
Windows 10 Magnifier settings.

Magnifier is an application that can be turned on when you need to take a closer look at something on the screen.

Microsoft published a guide for using magnifier, including tips for customizing the way Magnifier behaves to suit your needs.

Once you have configured your preferences, it is very easy to use Magnifier whenever you need it and then turn it off again.

You can turn Magnifier on by pressing the WINDOWS KEY + PLUS.

Turn Magnifier off by pressing WINDOWS KEY + ESCAPE.

Speech Recognition

Windows 10 Speech Recognition settings.
Windows 10 Speech Recognition settings.

Windows 10 allows you to use your voice to dictate rather than type, and to control your computer.

From the Ease of Use center, click on “Speech” from the Interaction category to learn more.

For best results you will need to spend a little time training Windows to recognize your voice before you can make serious use of speech recognition.

You can turn speech recognition for dictation on by pressing the WINDOWS KEY + H.

To toggle speech recognition on or off to control your device, press WINDOWS KEY + S.

Microsoft also provides a list of speech recognition commands you can use.

Mac OS Built-in AT

The Mac OS also has assistive technology available for users with disabilities.

You can find the Mac OS built-in assistive technology by selecting “Accessibility” from the System Preferences.

  • VoiceOver is the screen reader for Mac OS, and unlike Windows, there is no commercial alternative available. When you select VoiceOver in the Accessibility Preferences, you can access training and the VoiceOver Utility, which allows you to configure the behavior of VoiceOver.
  • Zoom is the screen magnification for Mac OS. Extremely convenient and easy to use, you can configure Zoom to work with keyboard commands or a combination of keyboard and trackpad gestures.
  • Dictation is a Mac OS feature many people are already familiar with. It is often apparent in the Mac OS menus for other programs as a system resource. Dictation for Mac OS allows you to both dictate and control the computer.

Free or Inexpensive Document Readers

There are a variety of free to low-cost applications available for reading digital text aloud with Text To Speech voices. They might not have all the bells and whistles of programs your school might maintain in the computer lab, but they can help fill the gap.

  • ReadPlease for Windows has been around since 2003. It is a no-frills reading window that allows you to hear what is written on the screen.
  • NaturalReader Software is downloadable Text To Speech desktop software that allows you to listen to Microsoft Word files, webpages, PDF documents, and emails.
  • Balabolka is a free Text To Speech program designed to have increased clarity, articulation, and overall quality of speech. Balabolka can support many file formats, including MP3, WAV, OGG, and MP4, as well as ODT, DOC, EPUB, RTF, PDF, and HTML files.

Additional Online Education Resources for Faculty

There are many efforts currently underway to provide assistance for educating students with disabilities. Here are a just a few I’m aware of.

  • Bookshare is an organization that provides ebooks for people with reading barriers. Bookshare has developed some amazing and innovative technology and is one of the biggest sources for a variety of ebooks.
  • WGBH Distance Learning Center provides a variety of educational resources.
  • The TechMatrix is a repository of datasheets on hundreds of educational assistive technology products. If you have questions about a product, this is a good place to start looking for answers.
  • The Learning Policy Institute has compiled a list of resources specifically for the COVID-19 crisis.
  • The National Disability Rights Network also has a collection of COVID-19 related resources and information for educators and parents of students with disabilities.

Hopefully the above information can provide some good starting points for helping your students with disabilities get access to the support and resources they need.

Thanks for reading!